2019-11-27T12:35:26.246 INFO:root:teuthology version: 1.0.0-e749e7b 2019-11-27T12:35:26.247 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.rUtzqc.tmp -- --verbose --lock --description rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi --block --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547417 2019-11-27T12:35:26.286 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-27T12:35:26.347 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547417 branch: wip-mkogan-testing description: rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: mkogan@redhat.com first_in_suite: false job_id: '4547417' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-mkogan-testing ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd fast shutdown: false osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: notcmalloc sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 rgw: compression type: random ec-data-pool: false frontend: civetweb storage classes: LUKEWARM, FROZEN workunit: branch: wip-mkogan-testing sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 owner: scheduled_mkogan@teuthology priority: 90 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 suite: rgw:verify suite_branch: wip-mkogan-testing suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.4303 2019-11-27T12:35:26.348 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa; will attempt to use it 2019-11-27T12:35:26.348 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks 2019-11-27T12:35:26.349 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-27T12:35:26.350 INFO:teuthology.task.internal:Checking packages... 2019-11-27T12:35:26.363 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '00732956b62306ff37a7f7c81af9db807aae2dc8' 2019-11-27T12:35:26.363 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-27T12:35:26.363 INFO:teuthology.packaging:ref: None 2019-11-27T12:35:26.363 INFO:teuthology.packaging:tag: None 2019-11-27T12:35:26.364 INFO:teuthology.packaging:branch: wip-mkogan-testing 2019-11-27T12:35:26.364 INFO:teuthology.packaging:sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:35:26.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-mkogan-testing 2019-11-27T12:35:26.514 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7725.g0073295 2019-11-27T12:35:26.514 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-27T12:35:27.062 INFO:teuthology.task.internal:no buildpackages task found 2019-11-27T12:35:27.063 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-27T12:35:28.149 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-27T12:35:28.149 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-27T12:35:28.191 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T12:35:38.209 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T12:35:48.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T12:35:58.236 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_mkogan@teuthology', 'description': '/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547417', 'machine_type': 'smithi'} 2019-11-27T12:35:58.258 DEBUG:teuthology.lock.ops:locked ubuntu@smithi115.front.sepia.ceph.com, ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:35:58.377 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-27T12:35:58.571 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 7.6 2019-11-27T12:35:58.574 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 7.6 2019-11-27T12:35:58.872 INFO:teuthology.orchestra.console:Power off smithi005 2019-11-27T12:35:58.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-27T12:35:58.925 INFO:teuthology.orchestra.console:Power off smithi115 2019-11-27T12:35:58.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-27T12:35:58.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:35:58.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:03.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:03.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:07.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:07.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:07.376 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2019-11-27T12:36:07.402 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2019-11-27T12:36:07.478 INFO:teuthology.orchestra.console:Power on smithi005 2019-11-27T12:36:07.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-27T12:36:07.505 INFO:teuthology.orchestra.console:Power on smithi115 2019-11-27T12:36:07.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-27T12:36:07.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:07.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:11.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:11.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:15.729 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:15.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T12:36:15.957 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2019-11-27T12:36:15.991 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2019-11-27T12:36:16.058 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2019-11-27T12:36:16.093 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2019-11-27T12:38:31.829 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:38:40.944 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:38:50.026 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:38:59.085 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:08.141 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:17.084 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:17.193 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:26.158 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:35.213 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:44.273 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:53.357 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:54.666 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:39:54.901 INFO:teuthology.orchestra.run.smithi005:> hostname 2019-11-27T12:39:55.379 INFO:teuthology.orchestra.run.smithi005.stdout:smithi068 2019-11-27T12:39:55.379 INFO:teuthology.orchestra.run.smithi005:> grep smithi068 /etc/hosts 2019-11-27T12:39:55.431 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-11-27T12:39:55.431 INFO:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2019-11-27T12:39:55.537 INFO:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi068/smithi005/g' /etc/hosts 2019-11-27T12:39:55.594 INFO:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.68/172.21.15.5/g' /etc/hosts 2019-11-27T12:39:55.648 INFO:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi068/smithi005/g' /etc/hostname 2019-11-27T12:39:55.713 INFO:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2019-11-27T12:39:55.790 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2019-11-27T12:39:55.792 DEBUG:teuthology.parallel:result is None 2019-11-27T12:40:02.413 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:40:11.468 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:40:20.525 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:40:29.580 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:40:38.633 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:41:16.077 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:41:16.356 INFO:teuthology.orchestra.run.smithi115:> hostname 2019-11-27T12:41:16.788 INFO:teuthology.orchestra.run.smithi115.stdout:smithi068 2019-11-27T12:41:16.789 INFO:teuthology.orchestra.run.smithi115:> grep smithi068 /etc/hosts 2019-11-27T12:41:16.834 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-11-27T12:41:16.834 INFO:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2019-11-27T12:41:16.936 INFO:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi068/smithi115/g' /etc/hosts 2019-11-27T12:41:16.994 INFO:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.68/172.21.15.115/g' /etc/hosts 2019-11-27T12:41:17.050 INFO:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi068/smithi115/g' /etc/hostname 2019-11-27T12:41:17.102 INFO:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2019-11-27T12:41:17.154 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2019-11-27T12:41:17.155 DEBUG:teuthology.parallel:result is None 2019-11-27T12:41:17.363 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2019-11-27T12:41:17.364 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-27T12:41:17.379 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2019-11-27T12:41:17.379 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-27T12:41:17.393 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2019-11-27T12:41:17.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:41:17.394 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:41:17.502 INFO:teuthology.orchestra.run.smithi005:> true 2019-11-27T12:41:17.894 INFO:teuthology.orchestra.run.smithi005:> uname -m 2019-11-27T12:41:17.979 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2019-11-27T12:41:17.979 INFO:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2019-11-27T12:41:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Linux" 2019-11-27T12:41:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="7 (Core)" 2019-11-27T12:41:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2019-11-27T12:41:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2019-11-27T12:41:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="7" 2019-11-27T12:41:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T12:41:18.064 INFO:teuthology.orchestra.run.smithi005.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T12:41:18.065 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T12:41:18.065 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T12:41:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:18.066 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2019-11-27T12:41:18.079 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2019-11-27T12:41:18.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:41:18.080 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:41:18.166 INFO:teuthology.orchestra.run.smithi115:> true 2019-11-27T12:41:18.427 INFO:teuthology.orchestra.run.smithi115:> uname -m 2019-11-27T12:41:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2019-11-27T12:41:18.469 INFO:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2019-11-27T12:41:18.575 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Linux" 2019-11-27T12:41:18.575 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="7 (Core)" 2019-11-27T12:41:18.575 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="7" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T12:41:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T12:41:18.577 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:41:18.577 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T12:41:18.577 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T12:41:18.577 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T12:41:18.577 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T12:41:18.577 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:41:18.578 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2019-11-27T12:41:18.592 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-11-27T12:41:18.620 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSlpCdYla+bRGTwHFT/5m1Gn6qy4SlA5OzOI2XuTGLClT0j9EWByq+IsQRKVqUEPoiaVMiECgYxxPI6QjI1gRbZRXY/EoxNhgWDAPQxH9QSQ5L7Km4cbMvG20cWqHi6FQGHQkJXwtRJPqmsvqt7Bfm/ckqTP/HsY+EtMZRvbSXxg+wuqAu5ZVGj01D9InSm2vXMRjIR4jgLA14s9Tli5REVnlX/p+V21iUXYEucpHwN4OaLuU9y3ouStWrS64bmHG4rt5xzhHJxCfDLUUNGXvxoxZL315FXC7ksdsFDo8n1ZY8W/CsA1yO1fEGbfJfX0jKfYkSPm8LpJG2kF3lW4eB smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G8pJUeQJ+4OeSI/I3bfmcXvn7cl/bJOqHd7otnxNMNQGIIqE9YYnnl6lvTyaMK8but1WUxB6yvIR+7ibLZc+zq5egb9BUihqste1YlAPJPynDdUReFM7tdUyMZTKiu4xKcli1Vp6CgOIokkNQBGybhHTVBd1GTq/DfKl51iWn9AELXLumAtEYIeKrAbnBf9fly+yzbfm7V/LM58AMLRVscQcCLqdLCoF/zRvujHFyo3qutbU5wnenBBHhJltLee9Fa09yA06P5Z+QomDUWJkT25JxNuXxqEoo1h5xUoUNUUN/VNSXnxRNwkg5dLvD++OCCfDjIYx1aZfIR9FHIOP 2019-11-27T12:41:18.621 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-27T12:41:18.659 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-27T12:41:18.668 INFO:teuthology.task.internal:Saving configuration 2019-11-27T12:41:18.683 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-27T12:41:18.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-27T12:41:18.706 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-27 12:35:58.243003', u'locked_by': u'scheduled_mkogan@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi005.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGGVe2n7dYu0FRICcR+o3DCjCME8ny3Ekwq23/ywzKbuOORNh5H/Etrp9oIc03bkfsjpGJFAUUeISHcVDwhut4=', u'description': u'/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547417'} 2019-11-27T12:41:18.718 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-27 12:35:58.242982', u'locked_by': u'scheduled_mkogan@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi115.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB6PTFjg4uGB/NOF6+cuhnELtlTqfmI3hL/s0PJbS1/u/tyFbVRHqWjpy74S1OoFsnj2xSxdijZhcCewpix4Iw=', u'description': u'/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547417'} 2019-11-27T12:41:18.718 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-27T12:41:18.728 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-27T12:41:18.728 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-27T12:41:18.728 INFO:teuthology.run_tasks:Running task console_log... 2019-11-27T12:41:18.871 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-27T12:41:18.871 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-27T12:41:18.879 INFO:teuthology.task.internal:Opening connections... 2019-11-27T12:41:18.879 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:41:18.880 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:41:18.969 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:41:18.969 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:41:19.068 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-27T12:41:19.078 INFO:teuthology.orchestra.run.smithi115:> uname -m 2019-11-27T12:41:19.168 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2019-11-27T12:41:19.168 INFO:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2019-11-27T12:41:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Linux" 2019-11-27T12:41:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="7 (Core)" 2019-11-27T12:41:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2019-11-27T12:41:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2019-11-27T12:41:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="7" 2019-11-27T12:41:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T12:41:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T12:41:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T12:41:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:41:19.210 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2019-11-27T12:41:19.223 INFO:teuthology.orchestra.run.smithi005:> uname -m 2019-11-27T12:41:19.399 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2019-11-27T12:41:19.399 INFO:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2019-11-27T12:41:19.484 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Linux" 2019-11-27T12:41:19.484 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="7 (Core)" 2019-11-27T12:41:19.484 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2019-11-27T12:41:19.484 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="7" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T12:41:19.485 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:19.486 INFO:teuthology.orchestra.run.smithi005.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T12:41:19.486 INFO:teuthology.orchestra.run.smithi005.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T12:41:19.486 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T12:41:19.486 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T12:41:19.486 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:19.487 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2019-11-27T12:41:19.499 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-27T12:41:19.613 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-27T12:41:19.623 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-27T12:41:19.623 INFO:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2019-11-27T12:41:19.628 INFO:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2019-11-27T12:41:19.708 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-27T12:41:19.718 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-27T12:41:19.719 INFO:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2019-11-27T12:41:19.723 INFO:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2019-11-27T12:41:19.810 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-27T12:41:19.846 INFO:teuthology.run_tasks:Running task kernel... 2019-11-27T12:41:19.863 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2019-11-27T12:41:19.863 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-11-27T12:41:19.863 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:41:19.864 INFO:teuthology.orchestra.run.smithi115:> sudo package-cleanup -y --oldkernels 2019-11-27T12:41:20.632 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:41:22.395 INFO:teuthology.orchestra.run.smithi115.stdout:No old kernels to remove 2019-11-27T12:41:22.412 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:41:22.413 INFO:teuthology.orchestra.run.smithi005:> sudo package-cleanup -y --oldkernels 2019-11-27T12:41:23.343 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:41:25.493 INFO:teuthology.orchestra.run.smithi005.stdout:No old kernels to remove 2019-11-27T12:41:25.513 INFO:teuthology.orchestra.run.smithi005:> uname -r 2019-11-27T12:41:25.673 INFO:teuthology.orchestra.run.smithi005.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-27T12:41:25.673 INFO:teuthology.task.kernel:Running kernel on smithi005: 3.10.0-1062.4.1.el7.x86_64 2019-11-27T12:41:25.673 INFO:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2019-11-27T12:41:25.936 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:41:25.976 INFO:teuthology.orchestra.run.smithi005.stdout:Determining fastest mirrors 2019-11-27T12:41:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:41:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: ftp.linux.ncsu.edu 2019-11-27T12:41:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:41:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:41:28.320 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:41:28.475 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:41:28.475 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-27T12:41:29.877 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:41:30.905 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:30.905 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-27T12:41:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:30.914 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:41:30.914 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:41:30.914 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2019-11-27T12:41:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:41:30.915 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 50 M 2019-11-27T12:41:30.915 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 64 M 2019-11-27T12:41:30.915 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:41:30.919 INFO:teuthology.orchestra.run.smithi005.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T12:41:32.171 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:41:32.386 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:41:33.239 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:41:33.239 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:42:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T12:42:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T12:42:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:42:11.292 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:42:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-27T12:42:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:42:11.293 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:42:11.345 INFO:teuthology.orchestra.run.smithi005:> rpm -q kernel --last | head -n 1 2019-11-27T12:42:11.814 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 12:41:36 PM UTC 2019-11-27T12:42:11.817 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:11.817 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:11.818 INFO:teuthology.orchestra.run.smithi115:> uname -r 2019-11-27T12:42:11.946 INFO:teuthology.orchestra.run.smithi115.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-27T12:42:11.946 INFO:teuthology.task.kernel:Running kernel on smithi115: 3.10.0-1062.4.1.el7.x86_64 2019-11-27T12:42:11.946 INFO:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2019-11-27T12:42:12.187 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:42:12.224 INFO:teuthology.orchestra.run.smithi115.stdout:Determining fastest mirrors 2019-11-27T12:42:12.432 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:42:12.432 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: ftp.linux.ncsu.edu 2019-11-27T12:42:12.433 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:42:12.433 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:42:14.446 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:42:14.447 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:42:14.447 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-27T12:42:15.810 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:42:16.577 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:42:16.578 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:42:16.586 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:42:16.586 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:42:16.586 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:42:16.587 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2019-11-27T12:42:16.588 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:42:16.588 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 50 M 2019-11-27T12:42:16.588 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 64 M 2019-11-27T12:42:16.588 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:42:16.590 INFO:teuthology.orchestra.run.smithi115.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T12:42:17.757 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:42:17.979 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:42:18.930 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:42:18.930 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:42:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T12:42:55.134 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T12:42:55.134 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:42:55.135 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:42:55.135 INFO:teuthology.orchestra.run.smithi115.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-27T12:42:55.135 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:42:55.135 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:42:55.184 INFO:teuthology.orchestra.run.smithi115:> rpm -q kernel --last | head -n 1 2019-11-27T12:42:55.489 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 12:42:21 PM UTC 2019-11-27T12:42:55.490 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:55.490 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:55.491 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-11-27T12:42:55.491 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-27T12:42:55.491 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-27T12:42:55.491 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-11-27T12:42:55.491 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2019-11-27T12:42:55.491 INFO:teuthology.orchestra.run.smithi005:> rpm -q kernel --last | head -n 1 2019-11-27T12:42:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 12:41:36 PM UTC 2019-11-27T12:42:55.880 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:55.880 INFO:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2 2019-11-27T12:42:56.015 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.02 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 0.76.el7.centos 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Group : System Environment/Base 2019-11-27T12:42:56.016 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 0 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Relocations : (not relocatable) 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : CentOS BuildSystem 2019-11-27T12:42:56.017 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-27T12:42:56.018 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-27T12:42:56.019 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2019-11-27T12:42:56.019 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-27T12:42:56.020 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:56.020 INFO:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-27T12:42:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2019-11-27T12:42:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:42:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-27T12:42:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-27T12:42:56.987 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-27T12:42:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-27T12:42:57.055 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-27T12:42:57.093 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-27T12:42:57.105 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-27T12:42:58.301 INFO:teuthology.orchestra.run.smithi005.stderr:done 2019-11-27T12:42:58.303 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:42:58.372 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.hyGv9hoX7s 2019-11-27T12:42:58.372 INFO:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hyGv9hoX7s 2019-11-27T12:42:58.458 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.hyGv9hoX7s 2019-11-27T12:42:58.774 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.hyGv9hoX7s is 6KB 2019-11-27T12:42:58.866 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.hyGv9hoX7s 2019-11-27T12:42:58.953 INFO:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 0 2019-11-27T12:42:59.160 INFO:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2019-11-27T12:42:59.165 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-11-27T12:42:59.165 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2019-11-27T12:42:59.165 INFO:teuthology.orchestra.run.smithi115:> rpm -q kernel --last | head -n 1 2019-11-27T12:42:59.530 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 12:42:21 PM UTC 2019-11-27T12:43:11.472 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:43:11.472 INFO:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2 2019-11-27T12:43:11.641 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2 2019-11-27T12:43:11.641 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2019-11-27T12:43:11.641 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.02 2019-11-27T12:43:11.641 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 0.76.el7.centos 2019-11-27T12:43:11.641 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:Group : System Environment/Base 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 0 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-27T12:43:11.642 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:Relocations : (not relocatable) 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : CentOS BuildSystem 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2019-11-27T12:43:11.643 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:43:11.644 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-27T12:43:11.644 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-27T12:43:11.644 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-27T12:43:11.644 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2019-11-27T12:43:11.645 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-27T12:43:11.645 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:43:11.645 INFO:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-27T12:43:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2019-11-27T12:43:12.243 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:43:12.258 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-27T12:43:12.499 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-27T12:43:12.516 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-27T12:43:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-27T12:43:12.560 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-27T12:43:12.584 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-27T12:43:12.593 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-27T12:43:13.415 INFO:teuthology.orchestra.run.smithi115.stderr:done 2019-11-27T12:43:13.420 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:43:13.477 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.JpRqOvTNZ1 2019-11-27T12:43:13.478 INFO:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JpRqOvTNZ1 2019-11-27T12:43:13.550 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.JpRqOvTNZ1 2019-11-27T12:43:13.682 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.JpRqOvTNZ1 is 6KB 2019-11-27T12:43:13.735 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.JpRqOvTNZ1 2019-11-27T12:43:13.780 INFO:teuthology.orchestra.run.smithi115:> sudo grub2-set-default 0 2019-11-27T12:43:14.018 INFO:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2019-11-27T12:43:14.023 INFO:teuthology.misc:Re-opening connections... 2019-11-27T12:43:14.023 INFO:teuthology.misc:trying to connect to ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:43:14.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:43:14.025 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:43:14.126 INFO:teuthology.orchestra.run.smithi115:> true 2019-11-27T12:43:14.473 DEBUG:teuthology.misc:waited 0.450220823288 2019-11-27T12:43:15.474 INFO:teuthology.misc:trying to connect to ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:43:15.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:43:15.475 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:43:50.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2019-11-27T12:43:50.073 DEBUG:teuthology.misc:waited 36.0497479439 2019-11-27T12:43:51.074 INFO:teuthology.misc:trying to connect to ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:43:51.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:43:51.075 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:44:51.075 DEBUG:teuthology.orchestra.remote:timed out 2019-11-27T12:44:51.076 DEBUG:teuthology.misc:waited 97.0526678562 2019-11-27T12:44:52.076 INFO:teuthology.misc:trying to connect to ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:44:52.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:44:52.077 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:44:52.210 INFO:teuthology.orchestra.run.smithi005:> true 2019-11-27T12:44:52.664 DEBUG:teuthology.misc:waited 98.6405568123 2019-11-27T12:44:53.665 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-11-27T12:44:53.672 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-27T12:44:53.673 INFO:teuthology.orchestra.run.smithi005:> uname -r 2019-11-27T12:44:53.773 INFO:teuthology.orchestra.run.smithi005.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:44:53.773 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:44:53.773 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-27T12:44:53.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-27T12:44:53.774 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-27T12:44:53.774 INFO:teuthology.orchestra.run.smithi115:> uname -r 2019-11-27T12:45:11.363 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-11-27T12:45:11.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 695, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 184, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 428, in run r.execute() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 98, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 493, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 806, in open_session timeout=timeout, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 933, in open_channel raise e error: [Errno 104] Connection reset by peer 2019-11-27T12:45:12.399 INFO:teuthology.misc:Re-opening connections... 2019-11-27T12:45:12.399 INFO:teuthology.misc:trying to connect to ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:45:12.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:45:12.400 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:45:12.402 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2019-11-27T12:45:12.402 INFO:teuthology.misc:trying to connect to ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:45:12.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:45:12.404 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:45:12.539 INFO:teuthology.orchestra.run.smithi005:> true 2019-11-27T12:45:12.859 DEBUG:teuthology.misc:waited 0.459471940994 2019-11-27T12:45:13.861 INFO:teuthology.misc:trying to connect to ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:45:13.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:45:13.862 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:45:13.961 INFO:teuthology.orchestra.run.smithi115:> true 2019-11-27T12:45:14.285 DEBUG:teuthology.misc:waited 1.88554096222 2019-11-27T12:45:15.286 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-27T12:45:15.286 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-27T12:45:15.286 INFO:teuthology.orchestra.run.smithi115:> uname -r 2019-11-27T12:45:15.375 INFO:teuthology.orchestra.run.smithi115.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:45:15.376 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-27T12:45:15.376 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-27T12:45:16.377 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-11-27T12:45:16.377 INFO:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-27T12:45:16.518 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2019-11-27T12:45:16.530 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-11-27T12:45:16.530 INFO:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-27T12:45:16.604 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2019-11-27T12:45:16.615 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-27T12:45:16.626 INFO:teuthology.task.internal:Creating test directory... 2019-11-27T12:45:16.626 INFO:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-27T12:45:16.631 INFO:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-27T12:45:16.719 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-27T12:45:16.727 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-27T12:45:16.812 INFO:teuthology.task.internal:Creating archive directory... 2019-11-27T12:45:16.812 INFO:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-27T12:45:16.817 INFO:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-27T12:45:16.915 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-27T12:45:16.985 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-27T12:45:16.985 INFO:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T12:45:16.997 INFO:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T12:45:17.072 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T12:45:17.117 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T12:45:17.119 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-27T12:45:17.136 INFO:teuthology.task.internal:Configuring sudo... 2019-11-27T12:45:17.136 INFO:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-27T12:45:17.149 INFO:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-27T12:45:17.264 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-27T12:45:17.400 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-27T12:45:17.401 INFO:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-27T12:45:17.406 INFO:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-27T12:45:17.490 INFO:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T12:45:17.551 INFO:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T12:45:17.621 INFO:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T12:45:17.677 INFO:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T12:45:17.762 INFO:teuthology.orchestra.run.smithi115:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-27T12:45:17.816 INFO:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T12:45:17.929 INFO:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T12:45:18.044 INFO:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T12:45:18.143 INFO:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T12:45:18.249 INFO:teuthology.orchestra.run.smithi005:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-27T12:45:18.345 INFO:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2019-11-27T12:45:18.353 INFO:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2019-11-27T12:45:18.425 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-27T12:45:18.475 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-27T12:45:18.510 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-27T12:45:18.519 INFO:teuthology.task.internal:Starting timer... 2019-11-27T12:45:18.519 INFO:teuthology.run_tasks:Running task pcp... 2019-11-27T12:45:18.620 INFO:teuthology.run_tasks:Running task selinux... 2019-11-27T12:45:18.689 INFO:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2019-11-27T12:45:18.873 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: [ OK ] 2019-11-27T12:45:18.875 INFO:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2019-11-27T12:45:18.974 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: [ OK ] 2019-11-27T12:45:18.976 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-27T12:45:18.976 INFO:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2019-11-27T12:45:19.037 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2019-11-27T12:45:19.037 INFO:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2019-11-27T12:45:19.146 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2019-11-27T12:45:19.146 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi005.front.sepia.ceph.com': 'permissive'} 2019-11-27T12:45:19.146 INFO:teuthology.orchestra.run.smithi115:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-27T12:45:19.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T12:45:19.204 INFO:teuthology.orchestra.run.smithi005:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-27T12:45:19.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T12:45:19.333 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-27T12:45:19.333 INFO:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2019-11-27T12:45:19.400 INFO:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2019-11-27T12:45:19.534 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-27T12:45:19.566 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-11-27T12:45:19.596 INFO:teuthology.repo_utils:Fetching master from origin 2019-11-27T12:45:19.777 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-27T12:45:20.038 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-27T12:45:20.041 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com,smithi005.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-27T12:45:20.667 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-27T12:45:24.972 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-27T12:45:24.998 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:24 +0000 (0:00:00.073) 0:00:00.073 **** 2019-11-27T12:45:25.010 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:25 +0000 (0:00:00.011) 0:00:00.085 **** 2019-11-27T12:45:27.128 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi115.front.sepia.ceph.com] 2019-11-27T12:45:27.129 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:27.223 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:27 +0000 (0:00:02.213) 0:00:02.298 **** 2019-11-27T12:45:27.641 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T12:45:27.685 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:27 +0000 (0:00:00.461) 0:00:02.759 **** 2019-11-27T12:45:27.688 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:28.291 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-27T12:45:28.293 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-27T12:45:28.333 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:28 +0000 (0:00:00.648) 0:00:03.408 **** 2019-11-27T12:45:28.358 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-27T12:45:28.363 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:28.367 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi005.front.sepia.ceph.com] 2019-11-27T12:45:28.440 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:28 +0000 (0:00:00.106) 0:00:03.514 **** 2019-11-27T12:45:28.482 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:28 +0000 (0:00:00.042) 0:00:03.557 **** 2019-11-27T12:45:28.818 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T12:45:28.859 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:28 +0000 (0:00:00.377) 0:00:03.934 **** 2019-11-27T12:45:28.865 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:28.903 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-27T12:45:28.903 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:45:28.948 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:28 +0000 (0:00:00.088) 0:00:04.023 **** 2019-11-27T12:45:28.950 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:29.272 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi005.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-27T12:45:29.311 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:29 +0000 (0:00:00.362) 0:00:04.386 **** 2019-11-27T12:45:29.312 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:29.338 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:29.339 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-27T12:45:29.340 INFO:teuthology.task.ansible.out: skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:29.392 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:29 +0000 (0:00:00.080) 0:00:04.466 **** 2019-11-27T12:45:29.392 INFO:teuthology.task.ansible.out: 2019-11-27T12:45:29.710 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-27T12:45:29.711 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:45:29.747 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:29 +0000 (0:00:00.355) 0:00:04.822 **** 2019-11-27T12:45:30.535 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-27T12:45:30.535 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858728.97-23630285820322/source", "state": "file", "uid": 0} 2019-11-27T12:45:30.577 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:30 +0000 (0:00:00.830) 0:00:05.652 **** 2019-11-27T12:45:30.907 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858729.76-202769238615642/source", "state": "file", "uid": 0} 2019-11-27T12:45:30.942 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:30 +0000 (0:00:00.364) 0:00:06.017 **** 2019-11-27T12:45:31.133 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-27T12:45:31.135 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T12:45:31.361 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T12:45:31.465 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T12:45:31.703 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T12:45:31.819 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T12:45:35.526 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5z 2019-11-27T12:45:35.528 INFO:teuthology.task.ansible.out:ugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qts 2019-11-27T12:45:35.529 INFO:teuthology.task.ansible.out:Bt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.s 2019-11-27T12:45:35.530 INFO:teuthology.task.ansible.out:sh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7 2019-11-27T12:45:35.532 INFO:teuthology.task.ansible.out:gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV 2019-11-27T12:45:35.533 INFO:teuthology.task.ansible.out:+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi115.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQv 2019-11-27T12:45:35.535 INFO:teuthology.task.ansible.out:eKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi005.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} PLAY [teuthology] ************************************************************** skipping: no hosts matched PLAY [testnodes] *************************************************************** Wednesday 27 November 2019 12:45:33 +0000 (0:00:02.702) 0:00:08.720 **** Wednesday 27 November 20 2019-11-27T12:45:35.536 INFO:teuthology.task.ansible.out:19 12:45:33 +0000 (0:00:00.032) 0:00:08.752 **** TASK [Gathering Facts] ********************************************************* ok: [smithi115.front.sepia.ceph.com] [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Wednesday 27 November 2019 12:45:34 +0000 (0:00:00.980) 0:00:09.732 **** TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi115.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.282185", "end": "2019-11-27 12:45:35.181553", "rc": 0, "start": "2019-11-27 12:45:34.899368", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.583) 0:00:10.316 **** 2019-11-27T12:45:35.567 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-27T12:45:35.567 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011054", "end": "2019-11-27 12:45:35.545724", "failed_when_result": false, "rc": 0, "start": "2019-11-27 12:45:35.534670", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-27T12:45:35.608 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.366) 0:00:10.683 **** 2019-11-27T12:45:35.619 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-11-27T12:45:35.621 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] 2019-11-27T12:45:35.628 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-27T12:45:35.629 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:35.697 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.088) 0:00:10.772 **** 2019-11-27T12:45:35.743 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.046) 0:00:10.818 **** 2019-11-27T12:45:35.748 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-27T12:45:35.749 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:35.786 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.042) 0:00:10.861 **** 2019-11-27T12:45:35.811 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-27T12:45:35.812 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:35.848 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.062) 0:00:10.923 **** 2019-11-27T12:45:35.874 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:35.907 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.059) 0:00:10.982 **** 2019-11-27T12:45:35.944 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-27T12:45:35.946 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:35.981 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:35 +0000 (0:00:00.073) 0:00:11.056 **** 2019-11-27T12:45:36.090 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-11-27T12:45:36.092 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.212170", "end": "2019-11-27 12:45:36.069931", "rc": 0, "start": "2019-11-27 12:45:35.857761", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-27T12:45:36.127 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.145) 0:00:11.201 **** 2019-11-27T12:45:36.308 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-27T12:45:36.309 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:45:36.346 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.219) 0:00:11.421 **** 2019-11-27T12:45:36.475 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-27T12:45:36.475 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016575", "end": "2019-11-27 12:45:36.447118", "failed_when_result": false, "rc": 0, "start": "2019-11-27 12:45:36.430543", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-27T12:45:36.512 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.165) 0:00:11.587 **** 2019-11-27T12:45:36.538 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-27T12:45:36.539 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:36.575 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.063) 0:00:11.650 **** 2019-11-27T12:45:36.601 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-27T12:45:36.603 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:36.637 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.061) 0:00:11.712 **** 2019-11-27T12:45:36.663 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-27T12:45:36.664 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:36.700 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.062) 0:00:11.774 **** 2019-11-27T12:45:36.726 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T12:45:36.727 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-27T12:45:36.748 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-11-27T12:45:36.750 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:36.785 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.085) 0:00:11.860 **** 2019-11-27T12:45:36.811 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-27T12:45:36.813 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:45:36.848 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:36 +0000 (0:00:00.063) 0:00:11.923 **** 2019-11-27T12:45:37.051 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T12:45:37.051 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-27T12:45:37.156 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-27T12:45:37.158 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:45:37.196 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:45:37 +0000 (0:00:00.347) 0:00:12.271 **** 2019-11-27T12:45:37.401 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T12:45:37.402 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-27T12:45:37.560 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-27T12:45:37.686 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-27T12:45:37.895 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-27T12:45:37.970 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-27T12:45:38.221 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-27T12:45:38.317 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-27T12:45:38.527 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-27T12:45:38.654 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-27T12:45:38.884 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-27T12:45:38.991 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-27T12:45:39.222 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-27T12:45:39.338 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-27T12:45:39.559 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-27T12:45:39.686 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-27T12:45:39.906 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-27T12:45:39.980 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-27T12:45:40.241 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-27T12:45:40.284 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-27T12:45:40.575 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-27T12:45:40.607 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-27T12:45:40.897 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-27T12:45:40.950 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-27T12:45:41.239 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-27T12:45:41.261 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-27T12:45:41.538 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-27T12:45:41.571 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-27T12:45:41.852 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-27T12:45:41.905 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-27T12:45:42.186 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-27T12:45:42.239 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-27T12:45:42.518 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-27T12:45:42.570 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-27T12:45:42.853 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-27T12:45:42.927 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-27T12:45:43.174 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-27T12:45:43.268 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-27T12:45:43.497 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-27T12:45:43.622 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-27T12:45:43.822 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-27T12:45:43.947 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-27T12:45:44.153 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-27T12:45:44.267 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-27T12:45:44.427 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-27T12:45:44.614 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-27T12:45:44.677 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-27T12:45:44.967 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-27T12:45:44.989 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-27T12:45:45.314 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-27T12:45:45.316 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-27T12:45:45.611 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-27T12:45:45.665 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-27T12:45:45.883 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-27T12:45:45.997 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-27T12:45:46.216 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-27T12:45:46.341 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-27T12:45:46.510 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-27T12:45:46.676 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-27T12:45:46.781 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-27T12:45:47.020 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-27T12:45:47.126 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-27T12:45:47.365 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-27T12:45:47.449 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-27T12:45:47.700 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-27T12:45:47.754 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-27T12:45:48.026 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-27T12:45:48.049 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-27T12:45:48.363 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-27T12:45:48.392 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-27T12:45:48.700 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-27T12:45:48.722 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-27T12:45:49.005 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-27T12:45:49.068 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-27T12:45:49.349 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-27T12:45:49.372 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-27T12:45:49.692 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T12:45:49.693 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-27T12:45:50.030 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-27T12:45:50.041 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-27T12:45:50.369 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-27T12:45:50.387 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-27T12:45:50.656 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-27T12:45:50.731 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-27T12:45:50.964 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-27T12:45:51.059 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-27T12:45:51.285 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-27T12:45:51.399 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T12:45:51.621 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-27T12:45:51.727 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-27T12:45:51.924 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-27T12:45:52.076 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-27T12:45:52.254 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-27T12:45:52.426 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-27T12:45:52.587 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-27T12:45:52.745 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-27T12:45:52.902 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-27T12:45:53.089 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-27T12:45:53.236 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-27T12:45:53.439 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-27T12:45:53.544 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-27T12:45:53.763 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-27T12:45:53.879 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T12:45:54.109 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-27T12:45:54.224 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-27T12:45:54.455 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-27T12:45:54.569 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-27T12:45:54.795 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-27T12:45:54.913 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-27T12:45:55.155 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-27T12:45:55.230 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-27T12:45:55.492 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-27T12:45:55.577 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-27T12:45:55.830 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T12:45:55.926 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-27T12:45:56.156 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-27T12:45:56.259 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-27T12:45:56.503 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-27T12:45:56.601 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-27T12:45:56.844 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-27T12:45:56.930 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-27T12:45:57.171 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-27T12:45:57.256 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-27T12:45:57.507 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-27T12:45:57.592 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-27T12:45:57.842 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-27T12:45:57.927 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-27T12:45:58.170 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-27T12:45:58.244 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-27T12:45:58.509 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-27T12:45:58.583 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-27T12:45:58.849 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-27T12:45:58.920 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-27T12:45:59.187 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-27T12:45:59.272 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-27T12:45:59.513 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-27T12:45:59.587 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-27T12:45:59.848 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-27T12:45:59.902 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-27T12:46:00.193 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-27T12:46:00.217 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-27T12:46:00.527 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-27T12:46:00.538 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-27T12:46:00.869 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-27T12:46:00.871 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T12:46:01.202 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-27T12:46:01.203 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-27T12:46:01.531 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-27T12:46:01.553 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-27T12:46:01.813 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-27T12:46:01.898 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-27T12:46:02.149 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-27T12:46:02.233 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-27T12:46:02.477 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-27T12:46:02.582 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-27T12:46:02.805 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-27T12:46:02.890 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T12:46:03.135 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-27T12:46:03.241 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-27T12:46:03.465 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-27T12:46:03.570 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-27T12:46:03.798 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-27T12:46:03.903 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-27T12:46:04.102 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-27T12:46:04.238 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-27T12:46:04.414 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-27T12:46:04.582 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-27T12:46:04.739 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-27T12:46:04.897 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-27T12:46:05.074 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-27T12:46:05.241 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-27T12:46:05.378 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-27T12:46:05.566 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-27T12:46:05.692 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-27T12:46:05.902 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-27T12:46:06.029 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-27T12:46:06.227 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-27T12:46:06.352 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-27T12:46:06.559 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-27T12:46:06.675 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-27T12:46:06.914 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-27T12:46:07.009 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-27T12:46:07.227 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-27T12:46:07.352 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-27T12:46:07.551 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-27T12:46:07.701 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-27T12:46:07.870 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-27T12:46:08.050 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-27T12:46:08.218 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-27T12:46:08.366 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-27T12:46:08.557 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-27T12:46:08.682 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-27T12:46:08.859 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-27T12:46:09.035 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-27T12:46:09.212 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-27T12:46:09.368 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-27T12:46:09.555 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-27T12:46:09.711 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-27T12:46:09.898 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-27T12:46:09.982 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-27T12:46:10.210 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-27T12:46:10.276 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-27T12:46:10.558 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-27T12:46:10.590 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-27T12:46:10.883 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-27T12:46:10.915 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-27T12:46:11.204 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-27T12:46:11.258 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-27T12:46:11.546 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-27T12:46:11.588 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-27T12:46:11.888 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-27T12:46:11.889 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-27T12:46:12.209 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-27T12:46:12.231 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-27T12:46:12.534 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-27T12:46:12.561 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-27T12:46:12.883 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-27T12:46:12.903 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-27T12:46:13.238 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-27T12:46:13.481 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-27T12:46:13.548 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-27T12:46:13.560 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-27T12:46:13.872 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T12:46:13.907 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-27T12:46:14.219 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-27T12:46:14.242 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-27T12:46:14.585 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-27T12:46:14.866 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-27T12:46:14.979 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-27T12:46:15.015 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:15 +0000 (0:00:37.819) 0:00:50.090 **** 2019-11-27T12:46:15.049 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-27T12:46:15.085 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:15 +0000 (0:00:00.069) 0:00:50.160 **** 2019-11-27T12:46:15.134 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-27T12:46:15.138 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-27T12:46:15.139 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-27T12:46:15.141 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-27T12:46:15.142 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-27T12:46:15.144 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-27T12:46:15.145 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-27T12:46:15.146 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-27T12:46:15.148 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-27T12:46:15.149 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-27T12:46:15.150 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-27T12:46:15.152 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189 2019-11-27T12:46:15.153 INFO:teuthology.task.ansible.out:"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-27T12:46:15.195 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:15 +0000 (0:00:00.110) 0:00:50.270 **** 2019-11-27T12:46:15.242 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T12:46:15.243 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-27T12:46:15.587 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-27T12:46:15.959 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-27T12:46:16.178 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi115.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-27T12:46:16.215 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:16 +0000 (0:00:01.019) 0:00:51.290 **** 2019-11-27T12:46:16.314 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T12:46:16.314 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T12:46:16.596 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-27T12:46:16.659 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-27T12:46:16.918 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:16.920 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-27T12:46:17.262 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-27T12:46:17.297 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T12:46:17.298 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-27T12:46:17.430 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:17 +0000 (0:00:01.214) 0:00:52.505 **** 2019-11-27T12:46:17.456 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-27T12:46:17.492 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:17 +0000 (0:00:00.062) 0:00:52.567 **** 2019-11-27T12:46:17.551 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-27T12:46:17.556 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-27T12:46:17.557 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-27T12:46:17.559 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-27T12:46:17.560 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-27T12:46:17.561 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e595 2019-11-27T12:46:17.563 INFO:teuthology.task.ansible.out:3db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f3 2019-11-27T12:46:17.564 INFO:teuthology.task.ansible.out:2cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"nam 2019-11-27T12:46:17.566 INFO:teuthology.task.ansible.out:e": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalS 2019-11-27T12:46:17.567 INFO:teuthology.task.ansible.out:USE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@her 2019-11-27T12:46:17.569 INFO:teuthology.task.ansible.out:mes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd 2019-11-27T12:46:17.570 INFO:teuthology.task.ansible.out:", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642 2019-11-27T12:46:17.571 INFO:teuthology.task.ansible.out:c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce2332 2019-11-27T12:46:17.573 INFO:teuthology.task.ansible.out:5efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-27T12:46:17.614 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:17 +0000 (0:00:00.121) 0:00:52.688 **** 2019-11-27T12:46:17.620 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:17.621 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-27T12:46:17.973 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-27T12:46:17.975 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-27T12:46:18.295 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-27T12:46:18.296 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-27T12:46:18.333 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:18 +0000 (0:00:00.719) 0:00:53.408 **** 2019-11-27T12:46:18.339 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:18.340 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-27T12:46:18.683 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-27T12:46:18.685 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-27T12:46:18.717 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-27T12:46:19.027 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-27T12:46:19.080 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-27T12:46:19.381 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-27T12:46:19.392 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:19.435 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-27T12:46:19.760 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-27T12:46:19.761 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:19.771 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:19.782 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-27T12:46:19.783 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:19.794 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:20.126 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-27T12:46:20.127 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-27T12:46:20.158 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-27T12:46:20.461 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-27T12:46:20.524 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c63 2019-11-27T12:46:20.525 INFO:teuthology.task.ansible.out:74d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgn 2019-11-27T12:46:20.526 INFO:teuthology.task.ansible.out:VY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-27T12:46:20.796 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-27T12:46:20.798 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-27T12:46:20.879 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-27T12:46:21.139 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-27T12:46:21.212 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-27T12:46:21.485 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-27T12:46:21.496 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:21.569 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-27T12:46:21.828 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-27T12:46:21.829 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-27T12:46:21.839 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:21.841 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:21.852 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:21.863 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:21.864 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-27T12:46:22.206 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-27T12:46:22.217 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-27T12:46:22.571 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-27T12:46:22.572 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-27T12:46:22.574 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-27T12:46:22.913 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-27T12:46:22.914 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-27T12:46:22.930 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-27T12:46:23.263 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-27T12:46:23.264 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-27T12:46:23.285 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-27T12:46:23.607 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-27T12:46:23.629 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-27T12:46:23.941 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-27T12:46:23.973 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-27T12:46:24.246 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-27T12:46:24.248 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-27T12:46:24.320 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-27T12:46:24.579 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-27T12:46:24.656 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-27T12:46:24.908 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-27T12:46:25.024 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-27T12:46:25.026 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-27T12:46:25.263 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-27T12:46:25.389 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-27T12:46:25.390 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-27T12:46:25.617 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-27T12:46:25.732 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-27T12:46:25.961 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-27T12:46:26.085 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-27T12:46:26.308 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-27T12:46:26.310 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-27T12:46:26.455 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-27T12:46:26.457 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-27T12:46:26.663 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-27T12:46:26.664 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-27T12:46:26.802 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-27T12:46:27.012 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-27T12:46:27.185 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-27T12:46:27.354 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-27T12:46:27.504 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-27T12:46:27.703 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-27T12:46:27.867 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-27T12:46:28.015 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-27T12:46:28.215 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-27T12:46:28.372 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-27T12:46:28.570 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-27T12:46:28.572 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-27T12:46:28.716 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-27T12:46:28.925 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-27T12:46:28.926 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-27T12:46:29.062 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T12:46:29.259 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-27T12:46:29.373 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-27T12:46:29.601 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-27T12:46:29.675 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-27T12:46:29.954 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-27T12:46:30.007 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-27T12:46:30.306 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-27T12:46:30.359 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-27T12:46:30.361 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-27T12:46:30.643 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-27T12:46:30.717 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-27T12:46:30.718 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-27T12:46:30.990 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-27T12:46:31.074 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-27T12:46:31.076 INFO:teuthology.task.ansible.out: 2019-11-27T12:46:31.319 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T12:46:31.428 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-27T12:46:31.672 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-27T12:46:31.758 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-27T12:46:32.030 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-27T12:46:32.104 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-27T12:46:32.386 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-27T12:46:32.429 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-27T12:46:32.736 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-27T12:46:32.737 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-27T12:46:32.757 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-27T12:46:33.100 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS 2019-11-27T12:46:33.102 INFO:teuthology.task.ansible.out:9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-27T12:46:33.443 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-27T12:46:33.454 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-27T12:46:33.456 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T12:46:33.776 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-27T12:46:33.809 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-27T12:46:33.810 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-27T12:46:33.812 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-27T12:46:34.119 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-27T12:46:34.151 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-27T12:46:34.474 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-27T12:46:34.506 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-27T12:46:34.797 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-27T12:46:34.860 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-27T12:46:35.145 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-27T12:46:35.208 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-27T12:46:35.210 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-27T12:46:35.485 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-27T12:46:35.580 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-27T12:46:35.780 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-27T12:46:35.782 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T12:46:35.906 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-27T12:46:36.135 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-27T12:46:36.136 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-27T12:46:36.138 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-27T12:46:36.251 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-27T12:46:36.460 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-27T12:46:36.613 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-27T12:46:36.801 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-27T12:46:36.953 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-27T12:46:37.171 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-27T12:46:37.307 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-27T12:46:37.525 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-27T12:46:37.527 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-27T12:46:37.663 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-27T12:46:37.664 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-27T12:46:37.877 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-27T12:46:37.994 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-27T12:46:38.218 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-27T12:46:38.323 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-27T12:46:38.564 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-27T12:46:38.660 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-27T12:46:38.662 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-27T12:46:38.908 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-27T12:46:39.013 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-27T12:46:39.252 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-27T12:46:39.366 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-27T12:46:39.594 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-27T12:46:39.709 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-27T12:46:39.969 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-27T12:46:39.970 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-27T12:46:40.052 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-27T12:46:40.312 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-27T12:46:40.405 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-27T12:46:40.664 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-27T12:46:40.748 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T12:46:41.008 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-27T12:46:41.010 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-27T12:46:41.114 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-27T12:46:41.344 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-27T12:46:41.460 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-27T12:46:41.669 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-27T12:46:41.804 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-27T12:46:42.023 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-27T12:46:42.107 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-27T12:46:42.357 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-27T12:46:42.410 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-27T12:46:42.700 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-27T12:46:42.743 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-27T12:46:43.037 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T12:46:43.079 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-27T12:46:43.366 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-27T12:46:43.429 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-27T12:46:43.694 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-27T12:46:43.799 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-27T12:46:44.021 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-27T12:46:44.145 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-27T12:46:44.365 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-27T12:46:44.480 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-27T12:46:44.714 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-27T12:46:44.819 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-27T12:46:45.044 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-27T12:46:45.180 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-27T12:46:45.415 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-27T12:46:45.531 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-27T12:46:45.760 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-27T12:46:45.885 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-27T12:46:46.103 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-27T12:46:46.259 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-27T12:46:46.456 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-27T12:46:46.602 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-27T12:46:46.799 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-27T12:46:46.945 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-27T12:46:47.140 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-27T12:46:47.281 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-27T12:46:47.487 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-27T12:46:47.637 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-27T12:46:47.834 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-27T12:46:47.959 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-27T12:46:48.157 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-27T12:46:48.302 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-27T12:46:48.500 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-27T12:46:48.657 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-27T12:46:48.855 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-27T12:46:49.012 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-27T12:46:49.013 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-27T12:46:49.190 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-27T12:46:49.368 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-27T12:46:49.369 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-27T12:46:49.548 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-27T12:46:49.703 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-27T12:46:49.890 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-27T12:46:50.047 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-27T12:46:50.244 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-27T12:46:50.379 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-27T12:46:50.588 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-27T12:46:50.693 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-27T12:46:50.921 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-27T12:46:51.027 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-27T12:46:51.274 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-27T12:46:51.275 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-27T12:46:51.367 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-27T12:46:51.616 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-27T12:46:51.617 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-27T12:46:51.658 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-27T12:46:51.968 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-27T12:46:52.000 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-27T12:46:52.331 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-27T12:46:52.353 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-27T12:46:52.663 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-27T12:46:52.696 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-27T12:46:52.995 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-27T12:46:53.016 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-27T12:46:53.336 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-27T12:46:53.368 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-27T12:46:53.685 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-27T12:46:53.706 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-27T12:46:54.027 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-27T12:46:54.038 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-27T12:46:54.324 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-27T12:46:54.326 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T12:46:54.378 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-27T12:46:54.648 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-27T12:46:54.721 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-27T12:46:54.960 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-27T12:46:55.054 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:55 +0000 (0:00:36.721) 0:01:30.129 **** 2019-11-27T12:46:55.062 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-27T12:46:55.098 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:55.100 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.110 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.121 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.122 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.133 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.144 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.155 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.165 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:55.364 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-27T12:46:55.487 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:55.489 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-27T12:46:55.498 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:55.706 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:55.707 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-27T12:46:55.811 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:55.813 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-27T12:46:56.062 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:56.063 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-27T12:46:56.146 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:56.148 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-27T12:46:56.394 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:56.396 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-27T12:46:56.489 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:56.490 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-27T12:46:56.738 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:56.739 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-27T12:46:56.741 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T12:46:56.833 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:56.834 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-27T12:46:56.844 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.855 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.856 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.867 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.878 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.878 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.889 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.900 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.911 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.911 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.922 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.933 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.944 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.945 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.955 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.966 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.967 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.978 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.993 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:56.994 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.004 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.015 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.026 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.027 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.038 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.049 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.050 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.061 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:57.063 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.073 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.074 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.085 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.096 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.096 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.107 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.118 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.119 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.129 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.140 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.141 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.152 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.163 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.174 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.185 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.185 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.196 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.197 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.208 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.219 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.230 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.230 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.241 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.252 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.253 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.263 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.274 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.275 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.286 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.297 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.308 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.308 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.319 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.331 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.331 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.342 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.353 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.354 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.365 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.376 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.386 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.387 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.398 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:57.399 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.429 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T12:46:57.490 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:57.491 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.493 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.496 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.496 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.498 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.499 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.538 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:57 +0000 (0:00:02.483) 0:01:32.613 **** 2019-11-27T12:46:57.544 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.545 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.547 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.548 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.550 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.564 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.565 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.577 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.578 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.593 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.593 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.595 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.605 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.606 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.607 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.617 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.618 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.619 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.630 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.630 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.642 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.642 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.643 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.654 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.656 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.657 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.678 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.679 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.747 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:57 +0000 (0:00:00.209) 0:01:32.822 **** 2019-11-27T12:46:57.774 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-27T12:46:57.775 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:57.811 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:46:57 +0000 (0:00:00.064) 0:01:32.886 **** 2019-11-27T12:46:57.994 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:57.996 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-27T12:46:58.006 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:58.183 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:46:58.185 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-27T12:46:58.352 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:58.354 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-27T12:46:58.504 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:46:58.506 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-27T12:46:58.703 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:58.705 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-27T12:46:58.841 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:46:58.843 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-27T12:46:59.030 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:59.032 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-27T12:46:59.178 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:46:59.180 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-27T12:46:59.367 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T12:46:59.369 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-27T12:46:59.370 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.381 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.392 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.403 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.414 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.426 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.437 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.448 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.450 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.463 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.475 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.476 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.487 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.498 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.509 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.520 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.531 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.543 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:46:59.544 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.555 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.566 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.567 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.578 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.590 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.601 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.602 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.624 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.635 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.636 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.647 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.658 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.669 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.670 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.680 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.691 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.703 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.703 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.714 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.725 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.736 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.737 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.747 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.758 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.769 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.770 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.784 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.795 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.796 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.807 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.818 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.819 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.829 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.840 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.851 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.862 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.863 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.874 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.885 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:46:59.886 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.897 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.897 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.908 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.909 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.919 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.930 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.941 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.952 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.954 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.965 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.975 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.976 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.987 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.998 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:46:59.999 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.009 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.020 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.031 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.042 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.053 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.064 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.064 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.075 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.086 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.097 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.097 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.108 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.119 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.130 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.131 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.142 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.153 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.164 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.165 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.176 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.187 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.198 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.199 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.210 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.221 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.232 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.233 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:47:00.234 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.245 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.258 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.268 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.269 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.336 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:00 +0000 (0:00:02.524) 0:01:35.411 **** 2019-11-27T12:47:00.362 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-27T12:47:00.364 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:00.399 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:00 +0000 (0:00:00.062) 0:01:35.473 **** 2019-11-27T12:47:00.550 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:47:00.551 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-27T12:47:00.760 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-27T12:47:00.875 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-27T12:47:01.084 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-27T12:47:01.179 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-27T12:47:01.410 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-27T12:47:01.525 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-27T12:47:01.703 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-27T12:47:01.860 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-27T12:47:02.027 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-27T12:47:02.163 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-27T12:47:02.361 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-27T12:47:02.508 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-27T12:47:02.700 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-27T12:47:02.846 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-27T12:47:03.045 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-27T12:47:03.180 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-27T12:47:03.388 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-27T12:47:03.493 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-27T12:47:03.731 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-27T12:47:03.814 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-27T12:47:04.057 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-27T12:47:04.141 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-27T12:47:04.391 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-27T12:47:04.484 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-27T12:47:04.713 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-27T12:47:04.817 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-27T12:47:05.013 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-27T12:47:05.118 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-27T12:47:05.347 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-27T12:47:05.442 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-27T12:47:05.670 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-27T12:47:05.753 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-27T12:47:05.964 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-27T12:47:06.091 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-27T12:47:06.268 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-27T12:47:06.429 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-27T12:47:06.597 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-27T12:47:06.743 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-27T12:47:06.920 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-27T12:47:07.065 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-27T12:47:07.125 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:07 +0000 (0:00:06.726) 0:01:42.200 **** 2019-11-27T12:47:07.233 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-27T12:47:07.564 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-27T12:47:07.863 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-27T12:47:08.132 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-27T12:47:08.184 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-27T12:47:08.186 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858827.15-9383171083342/source", "state": "file", "uid": 0} 2019-11-27T12:47:08.220 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:08 +0000 (0:00:01.095) 0:01:43.295 **** 2019-11-27T12:47:08.247 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-27T12:47:08.248 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => { "msg": "Host smithi115.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-27T12:47:08.284 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:08 +0000 (0:00:00.063) 0:01:43.359 **** 2019-11-27T12:47:08.320 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-27T12:47:08.321 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-27T12:47:08.357 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:08 +0000 (0:00:00.072) 0:01:43.432 **** 2019-11-27T12:47:08.382 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-27T12:47:08.384 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:08.420 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:08 +0000 (0:00:00.062) 0:01:43.495 **** 2019-11-27T12:47:08.456 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:47:08.457 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-27T12:47:08.791 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-27T12:47:08.885 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-27T12:47:08.886 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.132209", "end": "2019-11-27 12:47:08.858360", "rc": 0, "start": "2019-11-27 12:47:08.726151", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-27T12:47:08.921 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:08 +0000 (0:00:00.500) 0:01:43.996 **** 2019-11-27T12:47:08.947 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-27T12:47:08.948 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:08.985 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:08 +0000 (0:00:00.063) 0:01:44.060 **** 2019-11-27T12:47:09.011 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-27T12:47:09.013 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.052 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.067) 0:01:44.127 **** 2019-11-27T12:47:09.079 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-27T12:47:09.080 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.116 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.064) 0:01:44.191 **** 2019-11-27T12:47:09.122 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:47:09.123 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-27T12:47:09.145 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-27T12:47:09.147 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.182 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.064) 0:01:44.256 **** 2019-11-27T12:47:09.208 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-27T12:47:09.209 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.244 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.062) 0:01:44.319 **** 2019-11-27T12:47:09.269 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-27T12:47:09.270 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.306 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.061) 0:01:44.381 **** 2019-11-27T12:47:09.342 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-27T12:47:09.344 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi115.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:09.379 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.072) 0:01:44.453 **** 2019-11-27T12:47:09.409 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.448 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.069) 0:01:44.523 **** 2019-11-27T12:47:09.454 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T12:47:09.455 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-27T12:47:09.505 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.057) 0:01:44.580 **** 2019-11-27T12:47:09.511 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-27T12:47:09.511 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.548 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.042) 0:01:44.623 **** 2019-11-27T12:47:09.573 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-27T12:47:09.575 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:09.609 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.061) 0:01:44.684 **** 2019-11-27T12:47:09.635 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-27T12:47:09.636 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.671 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.061) 0:01:44.746 **** 2019-11-27T12:47:09.673 INFO:teuthology.task.ansible.out: 2019-11-27T12:47:09.697 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-27T12:47:09.698 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:09.732 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.060) 0:01:44.807 **** 2019-11-27T12:47:09.757 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-27T12:47:09.758 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.794 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.062) 0:01:44.869 **** 2019-11-27T12:47:09.820 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-27T12:47:09.821 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.857 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.062) 0:01:44.932 **** 2019-11-27T12:47:09.883 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-27T12:47:09.888 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.924 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.067) 0:01:44.999 **** 2019-11-27T12:47:09.951 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-27T12:47:09.952 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:09.991 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:09 +0000 (0:00:00.066) 0:01:45.066 **** 2019-11-27T12:47:10.018 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-27T12:47:10.020 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:10.054 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.063) 0:01:45.129 **** 2019-11-27T12:47:10.080 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-27T12:47:10.082 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.117 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.062) 0:01:45.192 **** 2019-11-27T12:47:10.141 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-27T12:47:10.143 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.177 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.060) 0:01:45.252 **** 2019-11-27T12:47:10.202 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-27T12:47:10.204 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.238 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.060) 0:01:45.313 **** 2019-11-27T12:47:10.274 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-27T12:47:10.276 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.311 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.072) 0:01:45.386 **** 2019-11-27T12:47:10.346 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-27T12:47:10.348 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.385 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.074) 0:01:45.460 **** 2019-11-27T12:47:10.420 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-27T12:47:10.426 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.460 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.075) 0:01:45.535 **** 2019-11-27T12:47:10.485 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-27T12:47:10.487 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:10.523 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.062) 0:01:45.598 **** 2019-11-27T12:47:10.548 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-27T12:47:10.586 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.063) 0:01:45.661 **** 2019-11-27T12:47:10.591 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-27T12:47:10.592 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858829.53-11208950740103/source", "state": "file", "uid": 0} 2019-11-27T12:47:10.630 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.043) 0:01:45.705 **** 2019-11-27T12:47:10.635 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-27T12:47:10.637 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.675 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.044) 0:01:45.750 **** 2019-11-27T12:47:10.679 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-27T12:47:10.681 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => { "msg": "Host smithi005.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-27T12:47:10.717 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.041) 0:01:45.792 **** 2019-11-27T12:47:10.752 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-27T12:47:10.789 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.072) 0:01:45.864 **** 2019-11-27T12:47:10.816 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-27T12:47:10.817 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:10.850 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:10 +0000 (0:00:00.061) 0:01:45.925 **** 2019-11-27T12:47:10.983 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-27T12:47:10.984 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:47:11.024 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.173) 0:01:46.099 **** 2019-11-27T12:47:11.268 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-27T12:47:11.268 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.084692", "end": "2019-11-27 12:47:11.236325", "rc": 0, "start": "2019-11-27 12:47:11.151633", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-27T12:47:11.304 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.280) 0:01:46.379 **** 2019-11-27T12:47:11.331 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-27T12:47:11.332 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.367 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.062) 0:01:46.442 **** 2019-11-27T12:47:11.392 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-27T12:47:11.393 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.428 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.061) 0:01:46.503 **** 2019-11-27T12:47:11.454 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-27T12:47:11.456 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.491 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.062) 0:01:46.566 **** 2019-11-27T12:47:11.549 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-27T12:47:11.551 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.587 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.095) 0:01:46.661 **** 2019-11-27T12:47:11.614 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-27T12:47:11.615 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.651 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.064) 0:01:46.726 **** 2019-11-27T12:47:11.688 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-27T12:47:11.690 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.730 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.079) 0:01:46.805 **** 2019-11-27T12:47:11.767 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-27T12:47:11.768 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:11.769 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:11.811 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.075) 0:01:46.880 **** 2019-11-27T12:47:11.844 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-27T12:47:11.845 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.893 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.087) 0:01:46.968 **** 2019-11-27T12:47:11.923 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:11.966 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:11 +0000 (0:00:00.072) 0:01:47.041 **** 2019-11-27T12:47:11.992 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-27T12:47:11.993 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:12.038 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.072) 0:01:47.113 **** 2019-11-27T12:47:12.065 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-27T12:47:12.067 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.104 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.065) 0:01:47.179 **** 2019-11-27T12:47:12.131 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-27T12:47:12.132 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:12.169 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.064) 0:01:47.243 **** 2019-11-27T12:47:12.195 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-27T12:47:12.197 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.232 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.063) 0:01:47.307 **** 2019-11-27T12:47:12.238 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T12:47:12.239 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-27T12:47:12.261 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-27T12:47:12.263 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.300 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.068) 0:01:47.375 **** 2019-11-27T12:47:12.336 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-27T12:47:12.338 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.376 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.076) 0:01:47.451 **** 2019-11-27T12:47:12.419 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-27T12:47:12.420 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.459 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.082) 0:01:47.534 **** 2019-11-27T12:47:12.486 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-27T12:47:12.487 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:12.526 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.067) 0:01:47.601 **** 2019-11-27T12:47:12.552 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-27T12:47:12.554 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.599 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.072) 0:01:47.674 **** 2019-11-27T12:47:12.604 INFO:teuthology.task.ansible.out: 2019-11-27T12:47:12.632 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-27T12:47:12.634 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.670 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.071) 0:01:47.745 **** 2019-11-27T12:47:12.696 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-27T12:47:12.698 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.733 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.062) 0:01:47.808 **** 2019-11-27T12:47:12.759 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-27T12:47:12.760 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.795 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.061) 0:01:47.870 **** 2019-11-27T12:47:12.820 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-27T12:47:12.822 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.857 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.062) 0:01:47.932 **** 2019-11-27T12:47:12.885 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-27T12:47:12.886 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:12.921 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.063) 0:01:47.996 **** 2019-11-27T12:47:12.946 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-27T12:47:12.948 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T12:47:12.982 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:12 +0000 (0:00:00.060) 0:01:48.057 **** 2019-11-27T12:47:13.008 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-27T12:47:13.043 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:13 +0000 (0:00:00.061) 0:01:48.118 **** 2019-11-27T12:47:13.070 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:13.105 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:13 +0000 (0:00:00.061) 0:01:48.180 **** 2019-11-27T12:47:13.121 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T12:47:13.122 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-27T12:47:13.162 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:13 +0000 (0:00:00.057) 0:01:48.237 **** 2019-11-27T12:47:13.442 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-27T12:47:13.444 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:47:13.479 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:13 +0000 (0:00:00.316) 0:01:48.554 **** 2019-11-27T12:47:14.283 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-27T12:47:14.284 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858833.2-127968850628631/source", "state": "file", "uid": 0} 2019-11-27T12:47:14.472 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T12:47:14.473 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-27T12:47:15.295 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-27T12:47:15.296 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858834.3-252112758747218/source", "state": "file", "uid": 0} 2019-11-27T12:47:15.334 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:15 +0000 (0:00:01.855) 0:01:50.409 **** 2019-11-27T12:47:15.393 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T12:47:15.394 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-27T12:47:15.433 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:15 +0000 (0:00:00.098) 0:01:50.508 **** 2019-11-27T12:47:15.925 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-27T12:47:15.926 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-27T12:47:16.230 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T12:47:16.231 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-11-27T12:47:16.270 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:16 +0000 (0:00:00.836) 0:01:51.345 **** 2019-11-27T12:47:16.538 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-27T12:47:16.539 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858835.47-155061562206591/source", "state": "file", "uid": 0} 2019-11-27T12:47:17.684 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574858836.56-61013958103970/source", "state": "file", "uid": 0} 2019-11-27T12:47:17.724 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:17 +0000 (0:00:01.454) 0:01:52.799 **** 2019-11-27T12:47:18.082 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-27T12:47:18.397 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T12:47:18.437 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:18 +0000 (0:00:00.712) 0:01:53.512 **** 2019-11-27T12:47:18.439 INFO:teuthology.task.ansible.out: 2019-11-27T12:47:37.917 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-27T12:47:37.919 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:21.317989", "end": "2019-11-27 12:47:37.891181", "rc": 0, "start": "2019-11-27 12:47:16.573192", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * extras: ewr.edge.kernel.org\n * updates: mirror.atlanticmetro.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.jaleco.com", " * extras: ewr.edge.kernel.org", " * updates: mirror.atlanticmetro.net", "Metadata Cache Created"]} 2019-11-27T12:47:37.956 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:37 +0000 (0:00:19.518) 0:02:13.030 **** 2019-11-27T12:47:37.957 INFO:teuthology.task.ansible.out: 2019-11-27T12:47:38.300 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-27T12:47:38.302 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-27T12:47:38.606 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T12:47:38.646 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:38 +0000 (0:00:00.689) 0:02:13.720 **** 2019-11-27T12:47:38.672 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T12:47:38.673 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:38.714 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:38 +0000 (0:00:00.069) 0:02:13.789 **** 2019-11-27T12:47:38.741 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-27T12:47:38.742 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:38.776 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:38 +0000 (0:00:00.061) 0:02:13.851 **** 2019-11-27T12:47:38.802 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-27T12:47:38.804 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:38.838 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:38 +0000 (0:00:00.061) 0:02:13.913 **** 2019-11-27T12:47:38.864 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T12:47:38.866 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:38.899 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:38 +0000 (0:00:00.061) 0:02:13.974 **** 2019-11-27T12:47:38.937 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-27T12:47:38.938 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:38.978 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:38 +0000 (0:00:00.078) 0:02:14.053 **** 2019-11-27T12:47:39.004 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-27T12:47:39.006 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:39.040 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:39 +0000 (0:00:00.061) 0:02:14.115 **** 2019-11-27T12:47:39.065 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-27T12:47:39.067 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:39.101 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:39 +0000 (0:00:00.061) 0:02:14.176 **** 2019-11-27T12:47:39.127 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-27T12:47:39.128 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:39.162 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:39 +0000 (0:00:00.060) 0:02:14.237 **** 2019-11-27T12:47:40.532 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-27T12:47:40.533 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.052398", "end": "2019-11-27 12:47:40.500441", "rc": 0, "start": "2019-11-27 12:47:39.448043", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:47:40.571 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:40 +0000 (0:00:01.408) 0:02:15.646 **** 2019-11-27T12:47:41.383 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-27T12:47:41.383 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-27T12:47:41.419 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:41 +0000 (0:00:00.848) 0:02:16.494 **** 2019-11-27T12:47:41.444 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-27T12:47:41.446 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:41.480 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:41 +0000 (0:00:00.061) 0:02:16.555 **** 2019-11-27T12:47:41.506 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-27T12:47:41.507 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:41.540 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:41 +0000 (0:00:00.060) 0:02:16.615 **** 2019-11-27T12:47:41.566 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-27T12:47:41.567 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:41.606 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:41 +0000 (0:00:00.065) 0:02:16.681 **** 2019-11-27T12:47:41.633 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-27T12:47:41.635 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:41.668 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:41 +0000 (0:00:00.061) 0:02:16.743 **** 2019-11-27T12:47:42.585 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-27T12:47:42.586 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-27T12:47:42.623 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:42 +0000 (0:00:00.954) 0:02:17.698 **** 2019-11-27T12:47:45.048 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-27T12:47:45.049 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:26.270856", "end": "2019-11-27 12:47:45.017687", "rc": 0, "start": "2019-11-27 12:47:18.746831", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * extras: ewr.edge.kernel.org\n * updates: ewr.edge.kernel.org\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.jaleco.com", " * extras: ewr.edge.kernel.org", " * updates: ewr.edge.kernel.org", "Metadata Cache Created"]} 2019-11-27T12:47:45.085 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:45 +0000 (0:00:02.462) 0:02:20.160 **** 2019-11-27T12:47:45.415 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-27T12:47:45.707 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T12:47:45.745 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:45 +0000 (0:00:00.659) 0:02:20.820 **** 2019-11-27T12:47:45.772 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T12:47:45.774 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:45.810 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:45 +0000 (0:00:00.064) 0:02:20.885 **** 2019-11-27T12:47:45.836 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-27T12:47:45.838 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:45.874 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:45 +0000 (0:00:00.064) 0:02:20.949 **** 2019-11-27T12:47:45.901 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-27T12:47:45.903 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:45.939 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:45 +0000 (0:00:00.064) 0:02:21.014 **** 2019-11-27T12:47:45.965 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T12:47:45.967 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:46.003 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:45 +0000 (0:00:00.064) 0:02:21.078 **** 2019-11-27T12:47:46.029 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-27T12:47:46.030 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:46.066 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:46 +0000 (0:00:00.062) 0:02:21.141 **** 2019-11-27T12:47:46.091 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-27T12:47:46.093 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:46.127 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:46 +0000 (0:00:00.061) 0:02:21.202 **** 2019-11-27T12:47:46.152 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-27T12:47:46.153 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:46.189 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:46 +0000 (0:00:00.061) 0:02:21.264 **** 2019-11-27T12:47:46.215 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-27T12:47:46.217 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:46.251 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:46 +0000 (0:00:00.062) 0:02:21.326 **** 2019-11-27T12:47:47.533 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-27T12:47:47.534 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.953615", "end": "2019-11-27 12:47:47.500806", "rc": 0, "start": "2019-11-27 12:47:46.547191", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:47:47.571 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:47 +0000 (0:00:01.319) 0:02:22.646 **** 2019-11-27T12:47:48.083 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-27T12:47:48.083 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-27T12:47:48.120 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:48 +0000 (0:00:00.549) 0:02:23.195 **** 2019-11-27T12:47:48.146 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-27T12:47:48.147 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:48.182 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:48 +0000 (0:00:00.061) 0:02:23.256 **** 2019-11-27T12:47:48.208 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-27T12:47:48.209 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:48.243 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:48 +0000 (0:00:00.061) 0:02:23.318 **** 2019-11-27T12:47:48.269 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-27T12:47:48.270 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:48.312 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:48 +0000 (0:00:00.068) 0:02:23.387 **** 2019-11-27T12:47:48.338 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-27T12:47:48.339 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:48.375 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:48 +0000 (0:00:00.063) 0:02:23.450 **** 2019-11-27T12:47:49.326 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-27T12:47:49.327 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-27T12:47:49.365 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:49 +0000 (0:00:00.989) 0:02:24.440 **** 2019-11-27T12:47:50.194 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-27T12:47:50.195 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-27T12:47:50.230 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:50 +0000 (0:00:00.865) 0:02:25.305 **** 2019-11-27T12:47:51.057 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-27T12:47:51.058 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-27T12:47:51.884 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-27T12:47:52.658 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-27T12:47:52.696 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:52 +0000 (0:00:02.465) 0:02:27.771 **** 2019-11-27T12:47:53.022 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-27T12:47:53.022 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T12:47:53.060 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:53 +0000 (0:00:00.364) 0:02:28.135 **** 2019-11-27T12:47:53.857 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-27T12:47:53.857 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-27T12:47:54.578 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-27T12:47:55.401 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-27T12:47:55.439 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:55 +0000 (0:00:02.378) 0:02:30.514 **** 2019-11-27T12:47:55.465 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-27T12:47:55.467 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:47:55.502 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:55 +0000 (0:00:00.062) 0:02:30.577 **** 2019-11-27T12:47:55.538 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-27T12:47:55.540 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-27T12:47:55.574 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:55 +0000 (0:00:00.071) 0:02:30.649 **** 2019-11-27T12:47:55.911 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-27T12:47:55.913 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-27T12:47:55.950 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:55 +0000 (0:00:00.375) 0:02:31.025 **** 2019-11-27T12:47:55.986 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-27T12:47:55.987 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:47:56.008 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:47:56.019 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:47:56.029 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:47:56.069 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:56 +0000 (0:00:00.119) 0:02:31.144 **** 2019-11-27T12:47:59.242 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-27T12:47:59.244 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-27T12:47:59.280 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:47:59 +0000 (0:00:03.210) 0:02:34.355 **** 2019-11-27T12:48:00.262 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi005.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-27T12:48:01.192 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-27T12:48:02.080 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-27T12:48:02.144 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:02 +0000 (0:00:02.863) 0:02:37.219 **** 2019-11-27T12:48:02.482 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-27T12:48:02.484 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T12:48:02.519 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:02 +0000 (0:00:00.375) 0:02:37.594 **** 2019-11-27T12:48:03.469 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-27T12:48:03.470 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-27T12:48:04.305 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-27T12:48:04.400 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-27T12:48:04.402 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-27T12:48:04.436 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:04 +0000 (0:00:01.917) 0:02:39.511 **** 2019-11-27T12:48:04.461 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-27T12:48:04.463 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:04.497 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:04 +0000 (0:00:00.060) 0:02:39.572 **** 2019-11-27T12:48:05.116 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-27T12:48:05.116 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-27T12:48:05.155 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:05 +0000 (0:00:00.657) 0:02:40.230 **** 2019-11-27T12:48:05.181 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-27T12:48:05.183 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:05.218 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:05 +0000 (0:00:00.063) 0:02:40.293 **** 2019-11-27T12:48:05.256 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-27T12:48:05.258 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-27T12:48:05.297 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:05 +0000 (0:00:00.078) 0:02:40.372 **** 2019-11-27T12:48:05.376 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-27T12:48:05.378 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-27T12:48:05.422 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:05 +0000 (0:00:00.124) 0:02:40.497 **** 2019-11-27T12:48:05.639 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-27T12:48:05.677 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:05 +0000 (0:00:00.255) 0:02:40.752 **** 2019-11-27T12:48:05.724 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-27T12:48:05.726 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:48:05.736 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:48:05.746 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:48:05.757 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T12:48:05.795 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:05 +0000 (0:00:00.117) 0:02:40.870 **** 2019-11-27T12:48:06.299 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-27T12:48:06.299 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-27T12:48:06.335 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:06 +0000 (0:00:00.540) 0:02:41.410 **** 2019-11-27T12:48:06.361 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-27T12:48:06.363 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:06.399 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:06 +0000 (0:00:00.063) 0:02:41.474 **** 2019-11-27T12:48:06.706 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-27T12:48:06.708 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:48:06.743 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:06 +0000 (0:00:00.343) 0:02:41.817 **** 2019-11-27T12:48:07.089 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-27T12:48:07.091 INFO:teuthology.task.ansible.out:fatal: [smithi115.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-27T12:48:07.125 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:07 +0000 (0:00:00.382) 0:02:42.200 **** 2019-11-27T12:48:07.151 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-27T12:48:07.152 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:07.185 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:07 +0000 (0:00:00.059) 0:02:42.260 **** 2019-11-27T12:48:08.102 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-27T12:48:08.104 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-27T12:48:08.145 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:08 +0000 (0:00:00.959) 0:02:43.220 **** 2019-11-27T12:48:09.806 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-11-27 12:45:12 UTC", "ActiveEnterTimestampMonotonic": "19373392", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target system.slice time-sync.target var-run.mount basic.target local-fs.target systemd-journald.socket nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-11-27 12:45:12 UTC", "AssertTimestampMonotonic": "19372458", "Before": "xdm.service multi-user.target getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-11-27 12:45:12 UTC", "ConditionTimestampMonotonic": "19372458", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8943", "ExecMainStartTimestamp": "Wed 2019-11-27 12:45:12 UTC", "ExecMainStartTimestampMonotonic": "19373311", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbi 2019-11-27T12:48:09.807 INFO:teuthology.task.ansible.out:n/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Wed 2019-11-27 12:45:12 UTC] ; stop_time=[n/a] ; pid=8943 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-11-27 12:45:12 UTC", "InactiveExitTimestampMonotonic": "19373392", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8943", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", 2019-11-27T12:48:09.809 INFO:teuthology.task.ansible.out: "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-11-27 12:45:12 UTC", "WatchdogTimestampMonotonic": "19373362", "WatchdogUSec": "0"}} Wednesday 27 November 2019 12:48:09 +0000 (0:00:01.216) 0:02:44.437 **** 2019-11-27T12:48:09.815 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-27T12:48:09.817 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004768", "end": "2019-11-27 12:48:09.786621", "rc": 0, "start": "2019-11-27 12:48:09.781853", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-27T12:48:09.852 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:09 +0000 (0:00:00.489) 0:02:44.927 **** 2019-11-27T12:48:10.534 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-27T12:48:10.536 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-27T12:48:10.570 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:10 +0000 (0:00:00.718) 0:02:45.645 **** 2019-11-27T12:48:11.219 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-27T12:48:11.220 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-27T12:48:11.259 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:11 +0000 (0:00:00.688) 0:02:46.334 **** 2019-11-27T12:48:11.285 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-27T12:48:11.287 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:11.327 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:11 +0000 (0:00:00.067) 0:02:46.401 **** 2019-11-27T12:48:12.235 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-27T12:48:12.236 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-27T12:48:12.277 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:12 +0000 (0:00:00.950) 0:02:47.352 **** 2019-11-27T12:48:13.935 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-27T12:48:13.935 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-27T12:48:13.971 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:13 +0000 (0:00:01.694) 0:02:49.046 **** 2019-11-27T12:48:13.996 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-27T12:48:13.998 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:14.033 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:14 +0000 (0:00:00.061) 0:02:49.108 **** 2019-11-27T12:48:14.368 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-27T12:48:14.370 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:48:14.403 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:14 +0000 (0:00:00.370) 0:02:49.478 **** 2019-11-27T12:48:14.742 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-27T12:48:14.744 INFO:teuthology.task.ansible.out:fatal: [smithi005.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-27T12:48:14.778 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:14 +0000 (0:00:00.374) 0:02:49.853 **** 2019-11-27T12:48:14.813 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-27T12:48:14.815 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:14.849 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:14 +0000 (0:00:00.071) 0:02:49.924 **** 2019-11-27T12:48:15.810 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-27T12:48:15.811 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-27T12:48:15.847 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:15 +0000 (0:00:00.997) 0:02:50.922 **** 2019-11-27T12:48:15.968 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-27T12:48:15.969 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-27T12:48:16.012 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:16 +0000 (0:00:00.158) 0:02:51.081 **** 2019-11-27T12:48:16.280 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-27T12:48:16.281 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-11-27 12:44:26 UTC", "ActiveEnterTimestampMonotonic": "19011871", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target var-run.mount basic.target time-sync.target local-fs.target nss-lookup.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-11-27 12:44:26 UTC", "AssertTimestampMonotonic": "19011172", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-11-27 12:44:26 UTC", "ConditionTimestampMonotonic": "19011171", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8758", "ExecMainStartTimestamp": "Wed 2019-11-27 12:44:26 UTC", "ExecMainStartTimestampMonotonic": "19011817", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-27T12:48:16.283 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Wed 2019-11-27 12:44:26 UTC] ; stop_time=[n/a] ; pid=8758 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-11-27 12:44:26 UTC", "InactiveExitTimestampMonotonic": "19011871", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8758", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-27T12:48:16.284 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-11-27 12:44:26 UTC", "WatchdogTimestampMonotonic": "19011853", "WatchdogUSec": "0"}} 2019-11-27T12:48:16.318 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:16 +0000 (0:00:00.311) 0:02:51.393 **** 2019-11-27T12:48:16.634 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-27T12:48:16.635 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004416", "end": "2019-11-27 12:48:16.606619", "rc": 0, "start": "2019-11-27 12:48:16.602203", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-27T12:48:16.673 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:16 +0000 (0:00:00.355) 0:02:51.748 **** 2019-11-27T12:48:17.178 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-27T12:48:17.216 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:17 +0000 (0:00:00.542) 0:02:52.291 **** 2019-11-27T12:48:17.391 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-27T12:48:17.429 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:17 +0000 (0:00:00.213) 0:02:52.504 **** 2019-11-27T12:48:17.431 INFO:teuthology.task.ansible.out: 2019-11-27T12:48:23.689 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-27T12:48:23.689 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-27T12:48:23.733 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:23 +0000 (0:00:06.303) 0:02:58.808 **** 2019-11-27T12:48:24.935 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-27T12:48:24.936 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-27T12:48:24.977 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:24 +0000 (0:00:01.243) 0:03:00.052 **** 2019-11-27T12:48:25.765 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-27T12:48:25.765 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.004120", "end": "2019-11-27 12:48:25.736840", "failed_when_result": false, "rc": 0, "start": "2019-11-27 12:48:17.732720", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-27T12:48:25.803 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:25 +0000 (0:00:00.825) 0:03:00.878 **** 2019-11-27T12:48:26.710 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-27T12:48:26.716 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-27T12:48:26.747 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:26 +0000 (0:00:00.944) 0:03:01.822 **** 2019-11-27T12:48:27.059 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-27T12:48:27.060 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015046", "end": "2019-11-27 12:48:27.025951", "rc": 0, "start": "2019-11-27 12:48:27.010905", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-27T12:48:27.098 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:27 +0000 (0:00:00.350) 0:03:02.172 **** 2019-11-27T12:48:27.432 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-27T12:48:27.434 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014950", "end": "2019-11-27 12:48:27.399829", "rc": 0, "start": "2019-11-27 12:48:27.384879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:48:27.483 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:27 +0000 (0:00:00.385) 0:03:02.558 **** 2019-11-27T12:48:33.938 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.625541", "end": "2019-11-27 12:48:33.907026", "failed_when_result": false, "rc": 0, "start": "2019-11-27 12:48:25.281485", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-27T12:48:33.979 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:33 +0000 (0:00:06.495) 0:03:09.054 **** 2019-11-27T12:48:34.928 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-27T12:48:34.968 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:34 +0000 (0:00:00.988) 0:03:10.043 **** 2019-11-27T12:48:35.336 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016342", "end": "2019-11-27 12:48:35.304612", "rc": 0, "start": "2019-11-27 12:48:35.288270", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-27T12:48:35.380 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:35 +0000 (0:00:00.412) 0:03:10.455 **** 2019-11-27T12:48:35.680 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.875714", "end": "2019-11-27 12:48:35.645335", "rc": 0, "start": "2019-11-27 12:48:27.769621", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:48:35.719 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:35 +0000 (0:00:00.338) 0:03:10.794 **** 2019-11-27T12:48:35.726 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-27T12:48:35.727 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.009579", "end": "2019-11-27 12:48:35.686562", "rc": 0, "start": "2019-11-27 12:48:35.676983", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:48:35.772 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:35 +0000 (0:00:00.049) 0:03:10.843 **** 2019-11-27T12:48:36.060 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-27T12:48:36.061 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-27T12:48:36.101 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:36 +0000 (0:00:00.332) 0:03:11.176 **** 2019-11-27T12:48:36.140 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-27T12:48:36.141 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-27T12:48:36.188 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:36 +0000 (0:00:00.087) 0:03:11.263 **** 2019-11-27T12:48:36.228 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-27T12:48:36.229 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T12:48:36.266 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:36 +0000 (0:00:00.077) 0:03:11.341 **** 2019-11-27T12:48:36.305 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-27T12:48:36.306 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-27T12:48:36.345 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:36 +0000 (0:00:00.078) 0:03:11.420 **** 2019-11-27T12:48:36.393 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi115.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T12:48:36.433 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:36 +0000 (0:00:00.087) 0:03:11.508 **** 2019-11-27T12:48:36.762 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-27T12:48:36.763 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T12:48:36.798 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:36 +0000 (0:00:00.365) 0:03:11.873 **** 2019-11-27T12:48:37.114 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-27T12:48:37.151 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:37 +0000 (0:00:00.352) 0:03:12.226 **** 2019-11-27T12:48:37.177 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-27T12:48:37.179 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:37.214 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:37 +0000 (0:00:00.063) 0:03:12.289 **** 2019-11-27T12:48:37.240 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-27T12:48:37.242 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:37.277 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:37 +0000 (0:00:00.062) 0:03:12.352 **** 2019-11-27T12:48:37.624 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-27T12:48:37.624 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-27T12:48:37.661 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:37 +0000 (0:00:00.384) 0:03:12.736 **** 2019-11-27T12:48:38.667 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-27T12:48:38.667 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-27T12:48:38.714 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:38 +0000 (0:00:01.052) 0:03:13.789 **** 2019-11-27T12:48:38.751 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-27T12:48:38.752 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi115"}, "changed": false} 2019-11-27T12:48:38.790 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:38 +0000 (0:00:00.075) 0:03:13.865 **** 2019-11-27T12:48:39.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-27T12:48:39.754 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi115.front.sepia.ceph.com", "ansible_hostname": "smithi115", "ansible_nodename": "smithi115"}, "changed": true, "name": "smithi115"} 2019-11-27T12:48:39.789 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:39 +0000 (0:00:00.999) 0:03:14.864 **** 2019-11-27T12:48:40.657 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-27T12:48:40.658 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-27T12:48:40.694 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:40 +0000 (0:00:00.905) 0:03:15.769 **** 2019-11-27T12:48:41.628 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-27T12:48:41.667 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:41 +0000 (0:00:00.971) 0:03:16.741 **** 2019-11-27T12:48:42.674 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi115.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-27T12:48:42.714 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:42 +0000 (0:00:01.048) 0:03:17.789 **** 2019-11-27T12:48:42.716 INFO:teuthology.task.ansible.out: 2019-11-27T12:48:43.597 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-27T12:48:43.642 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:43 +0000 (0:00:00.928) 0:03:18.717 **** 2019-11-27T12:48:43.979 INFO:teuthology.task.ansible.out: 2019-11-27T12:48:43.981 INFO:teuthology.task.ansible.out:TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T12:48:44.025 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:44 +0000 (0:00:00.382) 0:03:19.100 **** 2019-11-27T12:48:44.027 INFO:teuthology.task.ansible.out: 2019-11-27T12:48:44.353 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T12:48:44.355 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-27T12:48:44.394 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:44 +0000 (0:00:00.368) 0:03:19.469 **** 2019-11-27T12:48:44.732 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-27T12:48:44.733 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.638267", "end": "2019-11-27 12:48:44.703189", "rc": 0, "start": "2019-11-27 12:48:36.064922", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:48:44.735 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi115.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-27T12:48:44.772 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:44 +0000 (0:00:00.378) 0:03:19.847 **** 2019-11-27T12:48:44.809 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:44 +0000 (0:00:00.036) 0:03:19.884 **** 2019-11-27T12:48:45.132 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-27T12:48:45.134 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-27T12:48:45.170 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.361) 0:03:20.245 **** 2019-11-27T12:48:45.207 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-27T12:48:45.208 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-27T12:48:45.249 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.078) 0:03:20.324 **** 2019-11-27T12:48:45.285 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-27T12:48:45.287 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T12:48:45.325 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.076) 0:03:20.400 **** 2019-11-27T12:48:45.373 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-27T12:48:45.374 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-27T12:48:45.412 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.086) 0:03:20.487 **** 2019-11-27T12:48:45.479 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-27T12:48:45.481 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T12:48:45.517 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.105) 0:03:20.592 **** 2019-11-27T12:48:45.747 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-27T12:48:45.784 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.266) 0:03:20.859 **** 2019-11-27T12:48:45.831 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-27T12:48:45.832 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T12:48:45.870 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:45 +0000 (0:00:00.086) 0:03:20.945 **** 2019-11-27T12:48:46.213 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-27T12:48:46.215 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-27T12:48:46.251 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:46 +0000 (0:00:00.381) 0:03:21.326 **** 2019-11-27T12:48:46.277 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-27T12:48:46.279 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:46.314 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:46 +0000 (0:00:00.063) 0:03:21.389 **** 2019-11-27T12:48:46.340 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-27T12:48:46.341 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:46.377 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:46 +0000 (0:00:00.063) 0:03:21.452 **** 2019-11-27T12:48:46.726 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T12:48:46.727 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-27T12:48:46.765 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:46 +0000 (0:00:00.387) 0:03:21.840 **** 2019-11-27T12:48:46.771 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-27T12:48:46.772 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-27T12:48:46.811 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:46 +0000 (0:00:00.045) 0:03:21.886 **** 2019-11-27T12:48:47.852 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-27T12:48:47.853 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-27T12:48:47.893 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:47 +0000 (0:00:01.082) 0:03:22.968 **** 2019-11-27T12:48:47.930 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-27T12:48:47.932 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi005"}, "changed": false} 2019-11-27T12:48:47.967 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:47 +0000 (0:00:00.074) 0:03:23.042 **** 2019-11-27T12:48:48.501 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-27T12:48:48.503 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi005.front.sepia.ceph.com", "ansible_hostname": "smithi005", "ansible_nodename": "smithi005"}, "changed": true, "name": "smithi005"} 2019-11-27T12:48:48.540 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:48 +0000 (0:00:00.572) 0:03:23.615 **** 2019-11-27T12:48:49.179 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T12:48:49.180 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.084988", "end": "2019-11-27 12:48:49.145193", "rc": 0, "start": "2019-11-27 12:48:47.060205", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:48:49.227 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:49 +0000 (0:00:00.687) 0:03:24.302 **** 2019-11-27T12:48:49.255 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-27T12:48:49.300 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:49 +0000 (0:00:00.067) 0:03:24.369 **** 2019-11-27T12:48:49.480 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-27T12:48:49.481 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-27T12:48:49.543 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:49 +0000 (0:00:00.248) 0:03:24.618 **** 2019-11-27T12:48:50.200 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-27T12:48:50.203 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-27T12:48:50.492 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-27T12:48:50.494 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-27T12:48:50.529 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:50 +0000 (0:00:00.985) 0:03:25.604 **** 2019-11-27T12:48:51.121 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-27T12:48:51.121 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-27T12:48:51.174 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:51 +0000 (0:00:00.644) 0:03:26.249 **** 2019-11-27T12:48:51.200 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-27T12:48:51.202 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:51.238 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:51 +0000 (0:00:00.064) 0:03:26.313 **** 2019-11-27T12:48:51.299 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-27T12:48:51.300 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T12:48:51.310 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-27T12:48:51.355 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:51 +0000 (0:00:00.117) 0:03:26.430 **** 2019-11-27T12:48:51.382 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-27T12:48:51.383 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-27T12:48:51.421 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:51 +0000 (0:00:00.065) 0:03:26.496 **** 2019-11-27T12:48:51.427 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-27T12:48:51.429 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:51.469 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:51 +0000 (0:00:00.047) 0:03:26.543 **** 2019-11-27T12:48:51.505 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:48:51.507 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-27T12:48:51.542 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:51 +0000 (0:00:00.072) 0:03:26.616 **** 2019-11-27T12:48:52.051 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-27T12:48:52.053 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-27T12:48:52.088 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:52 +0000 (0:00:00.546) 0:03:27.163 **** 2019-11-27T12:48:52.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-27T12:48:52.347 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-27T12:48:52.384 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:52 +0000 (0:00:00.295) 0:03:27.459 **** 2019-11-27T12:48:52.711 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T12:48:52.712 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T12:48:52.751 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:52 +0000 (0:00:00.366) 0:03:27.826 **** 2019-11-27T12:48:53.077 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T12:48:53.079 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-27T12:48:53.135 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:53 +0000 (0:00:00.384) 0:03:28.210 **** 2019-11-27T12:48:53.506 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T12:48:53.507 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-27T12:48:53.560 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:53 +0000 (0:00:00.424) 0:03:28.635 **** 2019-11-27T12:48:54.502 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T12:48:54.503 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-27T12:48:54.542 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:54 +0000 (0:00:00.980) 0:03:29.616 **** 2019-11-27T12:48:55.519 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T12:48:55.520 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-27T12:48:55.562 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:55 +0000 (0:00:01.021) 0:03:30.637 **** 2019-11-27T12:48:55.716 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-27T12:48:55.717 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:03.266434", "end": "2019-11-27 12:48:55.675899", "rc": 0, "start": "2019-11-27 12:48:52.409465", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.jaleco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: ewr.edge.kernel.org\n * updates: mirror.atlanticmetro.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.jaleco.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: ewr.edge.kernel.org", " * updates: mirror.atlanticmetro.net", "No unfinished transactions left."]} 2019-11-27T12:48:55.755 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:55 +0000 (0:00:00.192) 0:03:30.830 **** 2019-11-27T12:48:56.142 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-27T12:48:56.143 INFO:teuthology.task.ansible.out:fatal: [smithi115.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.056375", "end": "2019-11-27 12:48:56.113857", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 12:48:56.057482", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-27T12:48:56.179 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:56 +0000 (0:00:00.423) 0:03:31.254 **** 2019-11-27T12:48:56.227 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-27T12:48:56.228 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:48:56.277 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:56 +0000 (0:00:00.097) 0:03:31.352 **** 2019-11-27T12:48:58.028 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T12:48:58.029 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.122160", "end": "2019-11-27 12:48:57.996792", "rc": 0, "start": "2019-11-27 12:48:55.874632", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:48:58.067 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:58 +0000 (0:00:01.790) 0:03:33.142 **** 2019-11-27T12:48:58.095 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-27T12:48:58.132 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:48:58 +0000 (0:00:00.065) 0:03:33.207 **** 2019-11-27T12:48:59.084 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-27T12:48:59.085 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-27T12:48:59.997 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-27T12:49:00.591 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:00 +0000 (0:00:01.908) 0:03:35.116 **** TASK [testnode : Install GPG] ************************************************** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 27 November 2019 12:49:00 +0000 (0:00:00.063) 0:03:35.180 **** TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi005.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi005.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} Wednesday 27 November 2019 12:49:00 +0000 (0:00:00.080) 0:03:35.260 **** TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 27 November 2019 12:49:00 +0000 (0:00:00.063) 0:03:35.324 **** TASK [testnode : set_fact] ***************************************************** ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} Wednesday 27 November 2019 12:49:00 +0000 (0:00:00.073) 0:03:35.397 **** 2019-11-27T12:49:00.817 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-27T12:49:00.819 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-27T12:49:00.861 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:00 +0000 (0:00:00.533) 0:03:35.930 **** 2019-11-27T12:49:01.516 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-27T12:49:01.516 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.339523", "end": "2019-11-27 12:49:01.486765", "rc": 0, "start": "2019-11-27 12:49:01.147242", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.jaleco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: ewr.edge.kernel.org\n * updates: ewr.edge.kernel.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.jaleco.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: ewr.edge.kernel.org", " * updates: ewr.edge.kernel.org", "No unfinished transactions left."]} 2019-11-27T12:49:01.552 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:01 +0000 (0:00:00.697) 0:03:36.627 **** 2019-11-27T12:49:01.911 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-27T12:49:01.912 INFO:teuthology.task.ansible.out:fatal: [smithi005.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.058229", "end": "2019-11-27 12:49:01.884552", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 12:49:01.826323", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-27T12:49:01.948 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:01 +0000 (0:00:00.395) 0:03:37.023 **** 2019-11-27T12:49:01.975 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:02.011 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:02 +0000 (0:00:00.062) 0:03:37.085 **** 2019-11-27T12:49:06.325 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T12:49:06.327 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-27T12:49:06.328 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-27T12:49:06.330 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T12:49:06.372 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:06 +0000 (0:00:04.361) 0:03:41.447 **** 2019-11-27T12:49:09.709 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-27T12:49:09.710 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-27T12:49:09.760 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:09 +0000 (0:00:03.387) 0:03:44.835 **** 2019-11-27T12:49:12.183 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 2019-11-27T12:49:12.184 INFO:teuthology.task.ansible.out: @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemov 2019-11-27T12:49:12.186 INFO:teuthology.task.ansible.out:ed:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T12:49:12.226 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:12 +0000 (0:00:02.465) 0:03:47.301 **** 2019-11-27T12:49:15.680 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-27T12:49:15.716 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:15 +0000 (0:00:03.489) 0:03:50.791 **** 2019-11-27T12:49:33.307 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid i 2019-11-27T12:49:34.509 INFO:teuthology.task.ansible.out:s already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel 2019-11-27T12:49:34.511 INFO:teuthology.task.ansible.out:-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.jaleco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: ewr.edge.kernel.org\n * updates: mirror.atlanticmetro.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53. 2019-11-27T12:49:34.513 INFO:teuthology.task.ansible.out:0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 12 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 2019-11-27T12:49:34.514 INFO:teuthology.task.ansible.out: 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.ce 2019-11-27T12:49:34.516 INFO:teuthology.task.ansible.out:ntos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T12:49:34.567 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:34 +0000 (0:00:18.851) 0:04:09.642 **** 2019-11-27T12:49:35.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-27T12:49:35.337 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-27T12:49:35.384 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:35 +0000 (0:00:00.817) 0:04:10.459 **** 2019-11-27T12:49:35.386 INFO:teuthology.task.ansible.out: 2019-11-27T12:49:35.917 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-27T12:49:35.966 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:35 +0000 (0:00:00.581) 0:04:11.041 **** 2019-11-27T12:49:36.008 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:36.048 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:36 +0000 (0:00:00.082) 0:04:11.123 **** 2019-11-27T12:49:36.475 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service system.slice basic.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ip6tables.service ipset.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": " 2019-11-27T12:49:36.476 INFO:teuthology.task.ansible.out:yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPr 2019-11-27T12:49:36.478 INFO:teuthology.task.ansible.out:iority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T12:49:36.511 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:36 +0000 (0:00:00.462) 0:04:11.586 **** 2019-11-27T12:49:36.513 INFO:teuthology.task.ansible.out: 2019-11-27T12:49:36.939 INFO:teuthology.task.ansible.out: 2019-11-27T12:49:36.940 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable iptables] ************************************ 2019-11-27T12:49:36.941 INFO:teuthology.task.ansible.out: fatal: [smithi115.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-27T12:49:36.983 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:36 +0000 (0:00:00.469) 0:04:12.056 **** 2019-11-27T12:49:36.984 INFO:teuthology.task.ansible.out: 2019-11-27T12:49:37.779 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-27T12:49:37.780 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-27T12:49:37.828 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:37 +0000 (0:00:00.847) 0:04:12.903 **** 2019-11-27T12:49:37.857 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-27T12:49:37.858 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:37.896 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:37 +0000 (0:00:00.067) 0:04:12.971 **** 2019-11-27T12:49:37.923 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-27T12:49:37.961 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:37 +0000 (0:00:00.065) 0:04:13.036 **** 2019-11-27T12:49:37.988 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-27T12:49:37.989 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.024 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.063) 0:04:13.099 **** 2019-11-27T12:49:38.053 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.092 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.067) 0:04:13.167 **** 2019-11-27T12:49:38.131 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-27T12:49:38.136 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.170 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.078) 0:04:13.245 **** 2019-11-27T12:49:38.198 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-27T12:49:38.199 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.236 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.065) 0:04:13.311 **** 2019-11-27T12:49:38.265 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-27T12:49:38.315 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.079) 0:04:13.390 **** 2019-11-27T12:49:38.348 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.384 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.065) 0:04:13.456 **** 2019-11-27T12:49:38.408 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-27T12:49:38.413 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.447 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.065) 0:04:13.522 **** 2019-11-27T12:49:38.478 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.514 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.066) 0:04:13.589 **** 2019-11-27T12:49:38.542 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.582 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.064) 0:04:13.654 **** 2019-11-27T12:49:38.608 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.644 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.063) 0:04:13.717 **** 2019-11-27T12:49:38.672 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.708 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.065) 0:04:13.783 **** 2019-11-27T12:49:38.735 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.779 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.067) 0:04:13.850 **** 2019-11-27T12:49:38.806 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.840 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.062) 0:04:13.913 **** 2019-11-27T12:49:38.877 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.916 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.075) 0:04:13.988 **** 2019-11-27T12:49:38.940 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:38.983 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:38 +0000 (0:00:00.066) 0:04:14.054 **** 2019-11-27T12:49:39.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.047 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.063) 0:04:14.118 **** 2019-11-27T12:49:39.070 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.109 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.066) 0:04:14.184 **** 2019-11-27T12:49:39.159 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-27T12:49:39.161 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.215 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.106) 0:04:14.290 **** 2019-11-27T12:49:39.224 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T12:49:39.229 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-27T12:49:39.232 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-27T12:49:39.234 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.jaleco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: ewr.edge.kernel.org\n * updates: ewr.edge.kernel.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n 2019-11-27T12:49:39.235 INFO:teuthology.task.ansible.out:\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 11 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 7/8 2019-11-27T12:49:39.237 INFO:teuthology.task.ansible.out: \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T12:49:39.270 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.055) 0:04:14.345 **** 2019-11-27T12:49:39.276 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-27T12:49:39.278 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.316 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.044) 0:04:14.390 **** 2019-11-27T12:49:39.341 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T12:49:39.342 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.380 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.064) 0:04:14.455 **** 2019-11-27T12:49:39.406 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T12:49:39.407 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.443 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.063) 0:04:14.518 **** 2019-11-27T12:49:39.469 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T12:49:39.471 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.509 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.065) 0:04:14.584 **** 2019-11-27T12:49:39.535 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T12:49:39.537 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.573 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.063) 0:04:14.648 **** 2019-11-27T12:49:39.599 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T12:49:39.601 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.637 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.064) 0:04:14.712 **** 2019-11-27T12:49:39.663 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T12:49:39.665 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.701 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.063) 0:04:14.775 **** 2019-11-27T12:49:39.727 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T12:49:39.729 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.766 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.064) 0:04:14.840 **** 2019-11-27T12:49:39.793 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.830 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.064) 0:04:14.904 **** 2019-11-27T12:49:39.856 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T12:49:39.858 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.896 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.066) 0:04:14.971 **** 2019-11-27T12:49:39.923 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T12:49:39.925 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:39.964 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:39 +0000 (0:00:00.067) 0:04:15.038 **** 2019-11-27T12:49:39.992 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T12:49:39.994 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:40.029 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.065) 0:04:15.104 **** 2019-11-27T12:49:40.056 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T12:49:40.057 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:40.103 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.074) 0:04:15.178 **** 2019-11-27T12:49:40.111 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-27T12:49:40.112 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-27T12:49:40.169 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.066) 0:04:15.244 **** 2019-11-27T12:49:40.437 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T12:49:40.438 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-27T12:49:40.474 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.304) 0:04:15.549 **** 2019-11-27T12:49:40.707 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T12:49:40.709 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-27T12:49:40.754 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.279) 0:04:15.829 **** 2019-11-27T12:49:40.794 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T12:49:40.796 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:40.834 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.080) 0:04:15.909 **** 2019-11-27T12:49:40.840 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T12:49:40.841 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T12:49:40.881 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:40 +0000 (0:00:00.046) 0:04:15.956 **** 2019-11-27T12:49:41.179 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. 2019-11-27T12:49:41.181 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-27T12:49:41.218 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.337) 0:04:16.293 **** 2019-11-27T12:49:41.245 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T12:49:41.246 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.298 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.079) 0:04:16.373 **** 2019-11-27T12:49:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-27T12:49:41.307 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service polkit.service system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service shutdown.target ipset.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-27T12:49:41.309 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-27T12:49:41.310 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T12:49:41.346 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.047) 0:04:16.421 **** 2019-11-27T12:49:41.352 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T12:49:41.354 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.390 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.044) 0:04:16.465 **** 2019-11-27T12:49:41.417 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T12:49:41.419 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.454 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.063) 0:04:16.529 **** 2019-11-27T12:49:41.480 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T12:49:41.482 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.524 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.069) 0:04:16.599 **** 2019-11-27T12:49:41.563 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T12:49:41.564 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.599 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.075) 0:04:16.674 **** 2019-11-27T12:49:41.636 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T12:49:41.638 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.672 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.072) 0:04:16.747 **** 2019-11-27T12:49:41.698 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T12:49:41.700 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.737 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.064) 0:04:16.812 **** 2019-11-27T12:49:41.746 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-27T12:49:41.747 INFO:teuthology.task.ansible.out:fatal: [smithi005.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-27T12:49:41.793 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.056) 0:04:16.868 **** 2019-11-27T12:49:41.799 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T12:49:41.801 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.844 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.050) 0:04:16.919 **** 2019-11-27T12:49:41.870 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T12:49:41.872 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.908 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.064) 0:04:16.983 **** 2019-11-27T12:49:41.934 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-27T12:49:41.936 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:41.970 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:41 +0000 (0:00:00.062) 0:04:17.045 **** 2019-11-27T12:49:41.997 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-27T12:49:41.998 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.034 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.063) 0:04:17.109 **** 2019-11-27T12:49:42.060 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T12:49:42.062 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.097 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.062) 0:04:17.172 **** 2019-11-27T12:49:42.134 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T12:49:42.136 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.176 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.074) 0:04:17.247 **** 2019-11-27T12:49:42.199 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-27T12:49:42.200 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.240 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.063) 0:04:17.310 **** 2019-11-27T12:49:42.270 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.034) 0:04:17.345 **** 2019-11-27T12:49:42.276 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-27T12:49:42.276 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.318 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.047) 0:04:17.393 **** 2019-11-27T12:49:42.324 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-27T12:49:42.326 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.364 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.044) 0:04:17.437 **** 2019-11-27T12:49:42.368 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-27T12:49:42.406 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.044) 0:04:17.481 **** 2019-11-27T12:49:42.417 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.452 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.045) 0:04:17.527 **** 2019-11-27T12:49:42.459 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-27T12:49:42.460 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.500 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.047) 0:04:17.575 **** 2019-11-27T12:49:42.510 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.551 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.048) 0:04:17.624 **** 2019-11-27T12:49:42.555 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-27T12:49:42.555 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.600 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.050) 0:04:17.675 **** 2019-11-27T12:49:42.605 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-27T12:49:42.607 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.645 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.044) 0:04:17.719 **** 2019-11-27T12:49:42.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-27T12:49:42.650 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.652 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.688 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.043) 0:04:17.763 **** 2019-11-27T12:49:42.693 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-27T12:49:42.695 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.732 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.043) 0:04:17.807 **** 2019-11-27T12:49:42.736 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-27T12:49:42.739 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.777 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.045) 0:04:17.852 **** 2019-11-27T12:49:42.783 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-27T12:49:42.784 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.821 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.043) 0:04:17.896 **** 2019-11-27T12:49:42.826 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-27T12:49:42.864 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.042) 0:04:17.939 **** 2019-11-27T12:49:42.869 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-27T12:49:42.870 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.909 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.044) 0:04:17.983 **** 2019-11-27T12:49:42.913 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-27T12:49:42.914 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.950 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.041) 0:04:18.025 **** 2019-11-27T12:49:42.954 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-27T12:49:42.959 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:42.993 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:42 +0000 (0:00:00.043) 0:04:18.068 **** 2019-11-27T12:49:42.997 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-27T12:49:42.998 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.035 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.041) 0:04:18.110 **** 2019-11-27T12:49:43.041 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:49:43.041 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-27T12:49:43.085 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.049) 0:04:18.160 **** 2019-11-27T12:49:43.091 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-27T12:49:43.092 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.131 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.046) 0:04:18.206 **** 2019-11-27T12:49:43.137 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-27T12:49:43.138 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.149 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-27T12:49:43.151 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi115.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.201 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.069) 0:04:18.276 **** 2019-11-27T12:49:43.207 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.208 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.210 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.251 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.050) 0:04:18.326 **** 2019-11-27T12:49:43.257 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-27T12:49:43.257 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.296 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.044) 0:04:18.371 **** 2019-11-27T12:49:43.322 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T12:49:43.324 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.361 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.065) 0:04:18.436 **** 2019-11-27T12:49:43.388 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-27T12:49:43.390 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.429 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.067) 0:04:18.504 **** 2019-11-27T12:49:43.435 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-27T12:49:43.436 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003868", "end": "2019-11-27 12:49:43.374275", "rc": 0, "start": "2019-11-27 12:49:43.370407", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-27T12:49:43.481 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.052) 0:04:18.556 **** 2019-11-27T12:49:43.488 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-27T12:49:43.489 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.527 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.045) 0:04:18.602 **** 2019-11-27T12:49:43.534 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.577 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.049) 0:04:18.651 **** 2019-11-27T12:49:43.582 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-27T12:49:43.584 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.621 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.044) 0:04:18.696 **** 2019-11-27T12:49:43.627 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-27T12:49:43.629 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.666 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.045) 0:04:18.741 **** 2019-11-27T12:49:43.673 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-27T12:49:43.673 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.711 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.044) 0:04:18.786 **** 2019-11-27T12:49:43.717 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-27T12:49:43.719 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.756 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.044) 0:04:18.831 **** 2019-11-27T12:49:43.762 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-27T12:49:43.763 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.803 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.046) 0:04:18.877 **** 2019-11-27T12:49:43.809 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-27T12:49:43.810 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.847 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.044) 0:04:18.922 **** 2019-11-27T12:49:43.853 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-27T12:49:43.856 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.893 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.045) 0:04:18.968 **** 2019-11-27T12:49:43.929 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-27T12:49:43.931 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:43.966 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:43 +0000 (0:00:00.072) 0:04:19.040 **** 2019-11-27T12:49:43.992 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-27T12:49:43.994 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.029 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.063) 0:04:19.104 **** 2019-11-27T12:49:44.055 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T12:49:44.056 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.092 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.062) 0:04:19.167 **** 2019-11-27T12:49:44.118 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T12:49:44.120 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.155 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.063) 0:04:19.230 **** 2019-11-27T12:49:44.182 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T12:49:44.183 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.218 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.062) 0:04:19.293 **** 2019-11-27T12:49:44.245 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T12:49:44.246 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.282 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.063) 0:04:19.357 **** 2019-11-27T12:49:44.309 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T12:49:44.311 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.347 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.065) 0:04:19.422 **** 2019-11-27T12:49:44.354 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-27T12:49:44.355 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-27T12:49:44.393 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.045) 0:04:19.468 **** 2019-11-27T12:49:44.400 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.441 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.047) 0:04:19.516 **** 2019-11-27T12:49:44.447 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T12:49:44.448 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item={u'block_used': 13034938, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289546, u'size_available': 930977980416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289546, "block_size": 4096, "block_total": 240324484, "block_used": 13034938, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977980416, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-27T12:49:44.493 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.051) 0:04:19.568 **** 2019-11-27T12:49:44.498 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T12:49:44.499 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.538 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.045) 0:04:19.613 **** 2019-11-27T12:49:44.565 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-27T12:49:44.565 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.603 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.065) 0:04:19.678 **** 2019-11-27T12:49:44.631 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T12:49:44.632 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.669 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.065) 0:04:19.744 **** 2019-11-27T12:49:44.695 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T12:49:44.697 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.733 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.064) 0:04:19.808 **** 2019-11-27T12:49:44.760 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T12:49:44.761 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.799 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.064) 0:04:19.872 **** 2019-11-27T12:49:44.814 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-27T12:49:44.815 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013573", "end": "2019-11-27 12:49:44.782985", "rc": 0, "start": "2019-11-27 12:49:44.769412", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:44.852 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.054) 0:04:19.927 **** 2019-11-27T12:49:44.858 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T12:49:44.859 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.898 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.045) 0:04:19.973 **** 2019-11-27T12:49:44.904 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-27T12:49:44.905 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'block_used': 13034938, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289546, u'size_available': 930977980416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289546, "block_size": 4096, "block_total": 240324484, "block_used": 13034938, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977980416, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:44.944 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:44 +0000 (0:00:00.045) 0:04:20.019 **** 2019-11-27T12:49:44.970 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-27T12:49:45.012 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:45 +0000 (0:00:00.068) 0:04:20.087 **** 2019-11-27T12:49:45.049 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T12:49:45.050 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYT7', u'wwn-0x5000c50091e302fc'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QYT7', u'wwn': u'0x5000c50091e302fc', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYT7-part1', u'wwn-0x5000c50091e302fc-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYT7", "wwn-0x5000c50091e302fc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYT7-part1", "wwn-0x5000c50091e302fc-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QYT7", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T12:49:45.052 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e302fc"}}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:45.230 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T12:49:45.231 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-27T12:49:45.269 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:45 +0000 (0:00:00.256) 0:04:20.344 **** 2019-11-27T12:49:45.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T12:49:45.615 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T12:49:45.650 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:45 +0000 (0:00:00.381) 0:04:20.725 **** 2019-11-27T12:49:45.981 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T12:49:45.982 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-27T12:49:46.020 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.369) 0:04:21.095 **** 2019-11-27T12:49:46.046 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T12:49:46.048 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.083 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.063) 0:04:21.158 **** 2019-11-27T12:49:46.110 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T12:49:46.112 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.153 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.070) 0:04:21.228 **** 2019-11-27T12:49:46.180 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T12:49:46.183 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.215 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.062) 0:04:21.290 **** 2019-11-27T12:49:46.254 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T12:49:46.255 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.296 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.075) 0:04:21.365 **** 2019-11-27T12:49:46.320 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T12:49:46.321 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.358 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.067) 0:04:21.433 **** 2019-11-27T12:49:46.385 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T12:49:46.386 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.422 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.063) 0:04:21.497 **** 2019-11-27T12:49:46.450 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T12:49:46.452 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.486 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.064) 0:04:21.561 **** 2019-11-27T12:49:46.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T12:49:46.514 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.550 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.064) 0:04:21.625 **** 2019-11-27T12:49:46.577 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T12:49:46.578 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.613 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.062) 0:04:21.688 **** 2019-11-27T12:49:46.643 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.687 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.073) 0:04:21.762 **** 2019-11-27T12:49:46.713 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-27T12:49:46.715 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.750 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.062) 0:04:21.825 **** 2019-11-27T12:49:46.787 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.830 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.080) 0:04:21.905 **** 2019-11-27T12:49:46.867 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T12:49:46.869 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.906 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.075) 0:04:21.981 **** 2019-11-27T12:49:46.943 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-27T12:49:46.945 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:46.989 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:46 +0000 (0:00:00.083) 0:04:22.064 **** 2019-11-27T12:49:47.000 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-VKOEeJ-nr81-m88k-MMj2-eb1k-E6Rh-Y5qu0T', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400UU400BGN', u'nvme-nvme.8086-50484654363230343030555534303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.606606", "end": "2019-11-27 12:49:46.945041", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-VKOEeJ-nr81-m88k-MMj2-eb1k-E6Rh-Y5qu0T", "nvme-INTEL_SSDPEDMD400G4_PHFT620400UU400BGN", "nvme-nvme.8086-50484654363230343030555534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019- 2019-11-27T12:49:47.002 INFO:teuthology.task.ansible.out:11-27 12:49:45.338435", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:47.020 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-27T12:49:47.022 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.058 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.068) 0:04:22.133 **** 2019-11-27T12:49:47.085 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-27T12:49:47.087 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.124 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.065) 0:04:22.199 **** 2019-11-27T12:49:47.151 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-27T12:49:47.153 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.187 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.063) 0:04:22.262 **** 2019-11-27T12:49:47.221 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-27T12:49:47.222 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.259 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.070) 0:04:22.333 **** 2019-11-27T12:49:47.296 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-27T12:49:47.298 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.333 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.074) 0:04:22.408 **** 2019-11-27T12:49:47.369 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-27T12:49:47.371 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.408 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.074) 0:04:22.482 **** 2019-11-27T12:49:47.434 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-27T12:49:47.436 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.474 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.066) 0:04:22.549 **** 2019-11-27T12:49:47.501 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-27T12:49:47.503 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.542 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.067) 0:04:22.617 **** 2019-11-27T12:49:47.568 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:49:47.570 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-27T12:49:47.606 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.064) 0:04:22.681 **** 2019-11-27T12:49:47.644 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-27T12:49:47.646 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.655 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-27T12:49:47.668 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.684 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.690 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.691 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.701 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-27T12:49:47.746 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.139) 0:04:22.821 **** 2019-11-27T12:49:47.890 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-27T12:49:47.892 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003879", "end": "2019-11-27 12:49:47.866230", "rc": 0, "start": "2019-11-27 12:49:47.862351", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-27T12:49:47.931 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.185) 0:04:23.006 **** 2019-11-27T12:49:47.958 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-27T12:49:47.959 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:48.002 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:47 +0000 (0:00:00.070) 0:04:23.077 **** 2019-11-27T12:49:48.031 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-27T12:49:48.033 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:48.068 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:48 +0000 (0:00:00.066) 0:04:23.143 **** 2019-11-27T12:49:48.095 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-27T12:49:48.097 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:48.132 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:48 +0000 (0:00:00.064) 0:04:23.207 **** 2019-11-27T12:49:48.159 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-27T12:49:48.160 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:48.194 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:48 +0000 (0:00:00.062) 0:04:23.269 **** 2019-11-27T12:49:48.337 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T12:49:48.338 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWosCLZMjhqM6iGQMrlAg4Pc8CodkfM6gme'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.061363", "end": "2019-11-27 12:49:48.301990", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWosCLZMjhqM6iGQMrlAg4Pc8CodkfM6gme"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:47.240627", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:48.681 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-27T12:49:48.683 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-27T12:49:48.718 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:48 +0000 (0:00:00.524) 0:04:23.793 **** 2019-11-27T12:49:48.759 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T12:49:48.760 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item={u'block_used': 13034946, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289538, u'size_available': 930977947648, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289538, "block_size": 4096, "block_total": 240324484, "block_used": 13034946, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977947648, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-27T12:49:48.796 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:48 +0000 (0:00:00.077) 0:04:23.871 **** 2019-11-27T12:49:49.142 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-27T12:49:49.144 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.014076", "end": "2019-11-27 12:49:49.114331", "rc": 0, "start": "2019-11-27 12:49:49.100255", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:49.179 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:49 +0000 (0:00:00.383) 0:04:24.254 **** 2019-11-27T12:49:49.216 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-27T12:49:49.217 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'block_used': 13034946, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289538, u'size_available': 930977947648, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289538, "block_size": 4096, "block_total": 240324484, "block_used": 13034946, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977947648, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:49.253 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:49 +0000 (0:00:00.074) 0:04:24.328 **** 2019-11-27T12:49:49.288 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-27T12:49:49.325 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:49 +0000 (0:00:00.071) 0:04:24.399 **** 2019-11-27T12:49:49.373 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T12:49:49.374 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQ1L', u'wwn-0x5000c500871a93fb'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HQ1L', u'wwn': u'0x5000c500871a93fb', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQ1L-part1', u'wwn-0x5000c500871a93fb-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ1L", "wwn-0x5000c500871a93fb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ1L-part1", "wwn-0x5000c500871a93fb-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ1L", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T12:49:49.375 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a93fb"}}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:49.702 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoveqxIeOQWB4UT0sOZaU0LyH1FmH1j2vn'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.059086", "end": "2019-11-27 12:49:49.669642", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoveqxIeOQWB4UT0sOZaU0LyH1FmH1j2vn"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:48.610556", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:51.058 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo4TfOBO1GepR8fAexdLe4Sme1gcagA020'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.058020", "end": "2019-11-27 12:49:51.019413", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo4TfOBO1GepR8fAexdLe4Sme1gcagA020"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:49.961393", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:51.123 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-jFuc8R-g7XC-zEtJ-dUrr-p1mw-Jljd-MlD9ST', u'nvme-INTEL_SSDPED1D480GA_PHMB751300EW480DGN', u'nvme-nvme.8086-50484d42373531333030455734383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.439221", "end": "2019-11-27 12:49:51.087483", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-jFuc8R-g7XC-zEtJ-dUrr-p1mw-Jljd-MlD9ST", "nvme-INTEL_SSDPED1D480GA_PHMB751300EW480DGN", "nvme-nvme.8086-50484d42373531333030455734383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:49.648262", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2019-11-27T12:49:51.124 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:52.413 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo8iXYFdDHrmvVoSebLh2UEGXGkSQ9sw3e'], u'uuids': [u'9f1634ed-f858-4f09-9982-987313b83325']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.062499", "end": "2019-11-27 12:49:52.378024", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo8iXYFdDHrmvVoSebLh2UEGXGkSQ9sw3e"], "labels": [], "masters": [], "uuids": ["9f1634ed-f858-4f09-9982-987313b83325"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:51.315525", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:52.497 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7Z5K0tWmc6cxgstZuXOcbmOPKNEl7KBU1'], u'uuids': [u'ec2855a3-f421-4a61-a0dd-44b3dff84bac']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.056922", "end": "2019-11-27 12:49:52.463163", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7Z5K0tWmc6cxgstZuXOcbmOPKNEl7KBU1"], "labels": [], "masters": [], "uuids": ["ec2855a3-f421-4a61-a0dd-44b3dff84bac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:51.406241", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:53.820 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoYVkHx9XljsjTWNmj3CepqnqRoSkcJtXA'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.087551", "end": "2019-11-27 12:49:53.777660", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoYVkHx9XljsjTWNmj3CepqnqRoSkcJtXA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:52.690109", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:53.885 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:53 +0000 (0:00:04.560) 0:04:28.960 **** 2019-11-27T12:49:53.894 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7bIPIaZsJ3AI246TOITuOqa3HkRucyoLb'], u'uuids': [u'0a68d5c2-3516-4377-9fcd-fab7cdfff189']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.059254", "end": "2019-11-27 12:49:53.830379", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7bIPIaZsJ3AI246TOITuOqa3HkRucyoLb"], "labels": [], "masters": [], "uuids": ["0a68d5c2-3516-4377-9fcd-fab7cdfff189"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:52.771125", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:53.930 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:53.931 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYT7', u'wwn-0x5000c50091e302fc'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QYT7', u'wwn': u'0x5000c50091e302fc', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYT7-part1', u'wwn-0x5000c50091e302fc-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYT7", "wwn-0x5000c50091e302fc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYT7-part1", "wwn-0x5000c50091e302fc-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QYT7", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T12:49:53.932 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e302fc"}}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:54.328 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-VKOEeJ-nr81-m88k-MMj2-eb1k-E6Rh-Y5qu0T', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400UU400BGN', u'nvme-nvme.8086-50484654363230343030555534303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087440", "end": "2019-11-27 12:49:54.297909", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-VKOEeJ-nr81-m88k-MMj2-eb1k-E6Rh-Y5qu0T", "nvme-INTEL_SSDPEDMD400G4_PHFT620400UU400BGN", "nvme-nvme.8086-50484654363230343030555534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:54.210469", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-27T12:49:54.329 INFO:teuthology.task.ansible.out:pied, 0.0806951 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0806951 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:54.833 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWosCLZMjhqM6iGQMrlAg4Pc8CodkfM6gme'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.207387", "end": "2019-11-27 12:49:54.791628", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWosCLZMjhqM6iGQMrlAg4Pc8CodkfM6gme"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:54.584241", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.200807 s, 574 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.200807 s, 574 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:55.266 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T12:49:55.267 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7n7u1fNZ2lnt1QYu83ewguwxUGKpTEzqq'], u'uuids': [u'66f3d77d-d1cb-4b1c-b774-fe5b251d8f04']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.068346", "end": "2019-11-27 12:49:55.229764", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7n7u1fNZ2lnt1QYu83ewguwxUGKpTEzqq"], "labels": [], "masters": [], "uuids": ["66f3d77d-d1cb-4b1c-b774-fe5b251d8f04"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:54.161418", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:55.361 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:55.362 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoveqxIeOQWB4UT0sOZaU0LyH1FmH1j2vn'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.218216", "end": "2019-11-27 12:49:55.330412", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoveqxIeOQWB4UT0sOZaU0LyH1FmH1j2vn"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:55.112196", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.211562 s, 545 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.211562 s, 545 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:55.834 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo4TfOBO1GepR8fAexdLe4Sme1gcagA020'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.181145", "end": "2019-11-27 12:49:55.804089", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo4TfOBO1GepR8fAexdLe4Sme1gcagA020"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:55.622944", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.175098 s, 659 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.175098 s, 659 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:56.310 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo8iXYFdDHrmvVoSebLh2UEGXGkSQ9sw3e'], u'uuids': [u'9f1634ed-f858-4f09-9982-987313b83325']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.184593", "end": "2019-11-27 12:49:56.281151", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWo8iXYFdDHrmvVoSebLh2UEGXGkSQ9sw3e"], "labels": [], "masters": [], "uuids": ["9f1634ed-f858-4f09-9982-987313b83325"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:56.096558", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.179122 s, 644 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.179122 s, 644 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:56.642 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T12:49:56.643 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7MXS0sZ6XZ56N5vm4sSAbL8qUUXRkZV48'], u'uuids': [u'4e2c85da-eeee-4c82-b38e-eaa1286708e4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.055296", "end": "2019-11-27 12:49:56.604763", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7MXS0sZ6XZ56N5vm4sSAbL8qUUXRkZV48"], "labels": [], "masters": [], "uuids": ["4e2c85da-eeee-4c82-b38e-eaa1286708e4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:55.549467", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:56.802 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:56.803 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoYVkHx9XljsjTWNmj3CepqnqRoSkcJtXA'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.191838", "end": "2019-11-27 12:49:56.775405", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-h0eu7ntX5BcRDMeuDzdkozpZnzKdBDWoYVkHx9XljsjTWNmj3CepqnqRoSkcJtXA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:56.583567", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.185423 s, 622 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.185423 s, 622 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:56.860 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:56 +0000 (0:00:02.973) 0:04:31.933 **** 2019-11-27T12:49:57.246 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-27T12:49:57.247 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.070368", "end": "2019-11-27 12:49:57.214678", "rc": 0, "start": "2019-11-27 12:49:57.144310", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:57.284 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:57 +0000 (0:00:00.425) 0:04:32.359 **** 2019-11-27T12:49:57.675 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054930", "end": "2019-11-27 12:49:57.643043", "rc": 0, "start": "2019-11-27 12:49:57.588113", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:57.723 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:57 +0000 (0:00:00.436) 0:04:32.795 **** 2019-11-27T12:49:57.750 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-27T12:49:57.800 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:57 +0000 (0:00:00.080) 0:04:32.875 **** 2019-11-27T12:49:57.829 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-27T12:49:57.831 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:57.892 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:57 +0000 (0:00:00.091) 0:04:32.967 **** 2019-11-27T12:49:57.920 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:57.968 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:57 +0000 (0:00:00.075) 0:04:33.043 **** 2019-11-27T12:49:57.995 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-27T12:49:57.997 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.050 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.081) 0:04:33.125 **** 2019-11-27T12:49:58.057 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T12:49:58.059 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7KknRBLtve7iZiGWphIL38Q2L01CQY9b4'], u'uuids': [u'4efad635-92ea-405b-8a17-f9af06415709']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.053045", "end": "2019-11-27 12:49:57.979799", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7KknRBLtve7iZiGWphIL38Q2L01CQY9b4"], "labels": [], "masters": [], "uuids": ["4efad635-92ea-405b-8a17-f9af06415709"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:56.926754", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T12:49:58.112 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.062) 0:04:33.187 **** 2019-11-27T12:49:58.120 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-27T12:49:58.121 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.182 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.069) 0:04:33.257 **** 2019-11-27T12:49:58.193 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:58.195 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQ1L', u'wwn-0x5000c500871a93fb'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HQ1L', u'wwn': u'0x5000c500871a93fb', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQ1L-part1', u'wwn-0x5000c500871a93fb-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ1L", "wwn-0x5000c500871a93fb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ1L-part1", "wwn-0x5000c500871a93fb-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ1L", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T12:49:58.197 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a93fb"}}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.516 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:49:58.553 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.371) 0:04:33.628 **** 2019-11-27T12:49:58.580 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:58.582 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-jFuc8R-g7XC-zEtJ-dUrr-p1mw-Jljd-MlD9ST', u'nvme-INTEL_SSDPED1D480GA_PHMB751300EW480DGN', u'nvme-nvme.8086-50484d42373531333030455734383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087011", "end": "2019-11-27 12:49:58.544842", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-jFuc8R-g7XC-zEtJ-dUrr-p1mw-Jljd-MlD9ST", "nvme-INTEL_SSDPED1D480GA_PHMB751300EW480DGN", "nvme-nvme.8086-50484d42373531333030455734383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:58.457831", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.080173 2019-11-27T12:49:58.583 INFO:teuthology.task.ansible.out: s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.080173 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:58.594 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T12:49:58.594 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={u'block_used': 13034938, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289546, u'size_available': 930977980416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289546, "block_size": 4096, "block_total": 240324484, "block_used": 13034938, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977980416, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.633 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.079) 0:04:33.708 **** 2019-11-27T12:49:58.670 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-27T12:49:58.672 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.725 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.091) 0:04:33.799 **** 2019-11-27T12:49:58.752 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:49:58.753 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.791 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.066) 0:04:33.866 **** 2019-11-27T12:49:58.824 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.860 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.069) 0:04:33.935 **** 2019-11-27T12:49:58.887 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-27T12:49:58.889 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:58.927 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.066) 0:04:34.001 **** 2019-11-27T12:49:58.963 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-27T12:49:58.967 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:59.001 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:58 +0000 (0:00:00.074) 0:04:34.076 **** 2019-11-27T12:49:59.027 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:59.029 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7Z5K0tWmc6cxgstZuXOcbmOPKNEl7KBU1'], u'uuids': [u'ec2855a3-f421-4a61-a0dd-44b3dff84bac']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.153668", "end": "2019-11-27 12:49:58.995383", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7Z5K0tWmc6cxgstZuXOcbmOPKNEl7KBU1"], "labels": [], "masters": [], "uuids": ["ec2855a3-f421-4a61-a0dd-44b3dff84bac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:58.841715", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.147067 s, 784 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.147067 s, 784 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:59.030 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:49:59.076 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:59 +0000 (0:00:00.065) 0:04:34.141 **** 2019-11-27T12:49:59.490 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:59.491 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7bIPIaZsJ3AI246TOITuOqa3HkRucyoLb'], u'uuids': [u'0a68d5c2-3516-4377-9fcd-fab7cdfff189']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.154327", "end": "2019-11-27 12:49:59.461403", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7bIPIaZsJ3AI246TOITuOqa3HkRucyoLb"], "labels": [], "masters": [], "uuids": ["0a68d5c2-3516-4377-9fcd-fab7cdfff189"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:59.307076", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.147845 s, 780 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.147845 s, 780 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:49:59.909 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-27T12:49:59.910 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-27T12:49:59.967 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:49:59 +0000 (0:00:00.901) 0:04:35.042 **** 2019-11-27T12:49:59.978 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:49:59.980 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7n7u1fNZ2lnt1QYu83ewguwxUGKpTEzqq'], u'uuids': [u'66f3d77d-d1cb-4b1c-b774-fe5b251d8f04']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146349", "end": "2019-11-27 12:49:59.926100", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7n7u1fNZ2lnt1QYu83ewguwxUGKpTEzqq"], "labels": [], "masters": [], "uuids": ["66f3d77d-d1cb-4b1c-b774-fe5b251d8f04"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:49:59.779751", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.140223 s, 823 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.140223 s, 823 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:00.408 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7MXS0sZ6XZ56N5vm4sSAbL8qUUXRkZV48'], u'uuids': [u'4e2c85da-eeee-4c82-b38e-eaa1286708e4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.154089", "end": "2019-11-27 12:50:00.380413", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7MXS0sZ6XZ56N5vm4sSAbL8qUUXRkZV48"], "labels": [], "masters": [], "uuids": ["4e2c85da-eeee-4c82-b38e-eaa1286708e4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:50:00.226324", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.147554 s, 782 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.147554 s, 782 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:00.755 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:00.855 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T12:50:00.861 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7KknRBLtve7iZiGWphIL38Q2L01CQY9b4'], u'uuids': [u'4efad635-92ea-405b-8a17-f9af06415709']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.153993", "end": "2019-11-27 12:50:00.813946", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zhkVKn8S5WQqfiDrTo3AEEZNN5YJXMB7KknRBLtve7iZiGWphIL38Q2L01CQY9b4"], "labels": [], "masters": [], "uuids": ["4efad635-92ea-405b-8a17-f9af06415709"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 12:50:00.659953", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.147725 s, 781 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.147725 s, 781 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:00.900 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:00 +0000 (0:00:00.932) 0:04:35.975 **** 2019-11-27T12:50:01.208 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:01.211 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:01.296 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-27T12:50:01.297 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.090683", "end": "2019-11-27 12:50:01.254186", "rc": 0, "start": "2019-11-27 12:50:01.163503", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:01.352 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:01 +0000 (0:00:00.452) 0:04:36.427 **** 2019-11-27T12:50:01.680 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:01.682 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:01.754 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-27T12:50:01.756 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051851", "end": "2019-11-27 12:50:01.723415", "rc": 0, "start": "2019-11-27 12:50:01.671564", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:01.791 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:01 +0000 (0:00:00.439) 0:04:36.866 **** 2019-11-27T12:50:01.818 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-27T12:50:01.859 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:01 +0000 (0:00:00.066) 0:04:36.933 **** 2019-11-27T12:50:01.885 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-27T12:50:01.886 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:01.924 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:01 +0000 (0:00:00.065) 0:04:36.999 **** 2019-11-27T12:50:01.951 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-27T12:50:01.953 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:01.989 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:01 +0000 (0:00:00.064) 0:04:37.064 **** 2019-11-27T12:50:02.016 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-27T12:50:02.017 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.055 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.065) 0:04:37.130 **** 2019-11-27T12:50:02.081 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-27T12:50:02.083 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.119 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.064) 0:04:37.194 **** 2019-11-27T12:50:02.179 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:02.180 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:02.460 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-27T12:50:02.462 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T12:50:02.496 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.376) 0:04:37.571 **** 2019-11-27T12:50:02.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T12:50:02.535 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={u'block_used': 13034946, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289538, u'size_available': 930977947648, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289538, "block_size": 4096, "block_total": 240324484, "block_used": 13034946, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977947648, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.575 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.076) 0:04:37.648 **** 2019-11-27T12:50:02.599 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-27T12:50:02.601 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.636 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.062) 0:04:37.711 **** 2019-11-27T12:50:02.665 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:50:02.666 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:02.708 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.071) 0:04:37.783 **** 2019-11-27T12:50:02.743 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.035) 0:04:37.818 **** 2019-11-27T12:50:02.748 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:50:02.749 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.787 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.043) 0:04:37.862 **** 2019-11-27T12:50:02.835 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-27T12:50:02.836 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.878 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.090) 0:04:37.953 **** 2019-11-27T12:50:02.926 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-27T12:50:02.927 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:02.963 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:02 +0000 (0:00:00.085) 0:04:38.038 **** 2019-11-27T12:50:02.990 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-27T12:50:02.991 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:03.027 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:03 +0000 (0:00:00.063) 0:04:38.102 **** 2019-11-27T12:50:03.055 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-27T12:50:03.056 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-27T12:50:03.091 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:03 +0000 (0:00:00.064) 0:04:38.166 **** 2019-11-27T12:50:03.139 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:03.141 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:03.421 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:03.568 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-27T12:50:03.569 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-27T12:50:03.607 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:03 +0000 (0:00:00.515) 0:04:38.682 **** 2019-11-27T12:50:03.734 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:03.735 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:04.035 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:04.109 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:04.110 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:04.343 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:04.345 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:04.391 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:04 +0000 (0:00:00.783) 0:04:39.465 **** 2019-11-27T12:50:04.594 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:04.595 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:04.691 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-27T12:50:04.693 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T12:50:04.737 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:04 +0000 (0:00:00.346) 0:04:39.812 **** 2019-11-27T12:50:04.775 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-27T12:50:04.777 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-27T12:50:04.842 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:04 +0000 (0:00:00.104) 0:04:39.917 **** 2019-11-27T12:50:05.058 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:05.059 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:05.516 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:05.573 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-27T12:50:05.575 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true} 2019-11-27T12:50:05.637 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:05 +0000 (0:00:00.795) 0:04:40.712 **** 2019-11-27T12:50:06.009 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T12:50:06.011 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T12:50:06.063 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.425) 0:04:41.138 **** 2019-11-27T12:50:06.398 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-27T12:50:06.441 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.378) 0:04:41.516 **** 2019-11-27T12:50:06.477 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.035) 0:04:41.552 **** 2019-11-27T12:50:06.496 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:06.498 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.513 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.550 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.072) 0:04:41.625 **** 2019-11-27T12:50:06.576 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-27T12:50:06.578 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.617 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.067) 0:04:41.692 **** 2019-11-27T12:50:06.653 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-27T12:50:06.655 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.690 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.073) 0:04:41.765 **** 2019-11-27T12:50:06.716 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-27T12:50:06.718 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.760 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.069) 0:04:41.835 **** 2019-11-27T12:50:06.788 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-27T12:50:06.789 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.827 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.067) 0:04:41.902 **** 2019-11-27T12:50:06.837 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:06.838 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:06.862 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.902 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.075) 0:04:41.977 **** 2019-11-27T12:50:06.932 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-27T12:50:06.934 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:06.971 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:06 +0000 (0:00:00.068) 0:04:42.046 **** 2019-11-27T12:50:07.144 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:07.145 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:07.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-27T12:50:07.428 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-27T12:50:07.479 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:07 +0000 (0:00:00.508) 0:04:42.554 **** 2019-11-27T12:50:07.486 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:07.487 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:07.520 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-27T12:50:07.522 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:07.560 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:07 +0000 (0:00:00.080) 0:04:42.635 **** 2019-11-27T12:50:07.586 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-27T12:50:07.588 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:07.637 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:07 +0000 (0:00:00.076) 0:04:42.712 **** 2019-11-27T12:50:07.799 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T12:50:07.799 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T12:50:07.839 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:07 +0000 (0:00:00.202) 0:04:42.914 **** 2019-11-27T12:50:08.203 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T12:50:08.248 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:08 +0000 (0:00:00.404) 0:04:43.319 **** 2019-11-27T12:50:08.288 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-27T12:50:08.289 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-27T12:50:08.333 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:08 +0000 (0:00:00.088) 0:04:43.407 **** 2019-11-27T12:50:08.577 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-27T12:50:08.584 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-27T12:50:08.615 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:08 +0000 (0:00:00.282) 0:04:43.690 **** 2019-11-27T12:50:08.641 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-27T12:50:08.643 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:08.700 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:08 +0000 (0:00:00.084) 0:04:43.774 **** 2019-11-27T12:50:08.708 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-27T12:50:08.709 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"changed": true} 2019-11-27T12:50:08.748 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:08 +0000 (0:00:00.048) 0:04:43.823 **** 2019-11-27T12:50:09.212 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-27T12:50:09.214 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target -.mount sntp.service systemd-journald.socket syslog.target system.slice tmp.mount ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-27T12:50:09.215 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-27T12:50:09.217 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-27T12:50:09.252 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.504) 0:04:44.327 **** 2019-11-27T12:50:09.288 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.035) 0:04:44.363 **** 2019-11-27T12:50:09.294 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-27T12:50:09.295 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.334 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.046) 0:04:44.409 **** 2019-11-27T12:50:09.360 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.397 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.062) 0:04:44.472 **** 2019-11-27T12:50:09.423 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-27T12:50:09.425 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.459 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.062) 0:04:44.534 **** 2019-11-27T12:50:09.496 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-27T12:50:09.498 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.532 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.072) 0:04:44.607 **** 2019-11-27T12:50:09.570 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-27T12:50:09.571 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.606 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.073) 0:04:44.681 **** 2019-11-27T12:50:09.633 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-27T12:50:09.635 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.671 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.064) 0:04:44.746 **** 2019-11-27T12:50:09.698 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-27T12:50:09.699 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:09.735 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:09 +0000 (0:00:00.064) 0:04:44.810 **** 2019-11-27T12:50:10.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-27T12:50:10.210 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-27T12:50:10.262 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:10 +0000 (0:00:00.523) 0:04:45.333 **** 2019-11-27T12:50:10.286 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-27T12:50:10.288 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:10.324 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:10 +0000 (0:00:00.065) 0:04:45.399 **** 2019-11-27T12:50:10.354 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-27T12:50:10.356 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:10.395 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:10 +0000 (0:00:00.070) 0:04:45.470 **** 2019-11-27T12:50:11.317 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-27T12:50:11.317 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-27T12:50:11.364 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:11 +0000 (0:00:00.968) 0:04:46.439 **** 2019-11-27T12:50:11.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:11.442 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:11 +0000 (0:00:00.078) 0:04:46.517 **** 2019-11-27T12:50:11.983 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sntp.service syslog.target ntpdate.service tmp.mount system.slice -.mount systemd-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "multi-user.target chronyd.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": " 2019-11-27T12:50:11.985 INFO:teuthology.task.ansible.out:0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551 2019-11-27T12:50:11.987 INFO:teuthology.task.ansible.out:615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T12:50:12.016 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:12 +0000 (0:00:00.574) 0:04:47.091 **** 2019-11-27T12:50:13.159 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-27T12:50:13.197 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:13 +0000 (0:00:01.181) 0:04:48.272 **** 2019-11-27T12:50:13.224 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-27T12:50:13.226 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:13.268 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:13 +0000 (0:00:00.070) 0:04:48.343 **** 2019-11-27T12:50:13.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-27T12:50:13.613 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-27T12:50:13.655 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:13 +0000 (0:00:00.387) 0:04:48.730 **** 2019-11-27T12:50:14.912 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-27T12:50:14.947 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:14 +0000 (0:00:01.292) 0:04:50.022 **** 2019-11-27T12:50:15.892 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-27T12:50:15.892 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-27T12:50:15.931 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:15 +0000 (0:00:00.983) 0:04:51.006 **** 2019-11-27T12:50:15.958 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-27T12:50:15.959 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:15.997 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:15 +0000 (0:00:00.066) 0:04:51.072 **** 2019-11-27T12:50:16.342 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-27T12:50:16.344 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-27T12:50:16.381 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:16 +0000 (0:00:00.383) 0:04:51.456 **** 2019-11-27T12:50:16.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-27T12:50:16.812 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:16 +0000 (0:00:00.430) 0:04:51.887 **** 2019-11-27T12:50:16.838 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-27T12:50:16.840 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:16.879 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:16 +0000 (0:00:00.063) 0:04:51.951 **** 2019-11-27T12:50:16.903 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-27T12:50:16.906 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-27T12:50:16.940 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:16 +0000 (0:00:00.064) 0:04:52.015 **** 2019-11-27T12:50:17.269 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi115.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-27T12:50:17.310 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:17 +0000 (0:00:00.366) 0:04:52.382 **** 2019-11-27T12:50:17.334 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:17.373 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:17 +0000 (0:00:00.062) 0:04:52.444 **** 2019-11-27T12:50:17.407 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:17 +0000 (0:00:00.037) 0:04:52.482 **** 2019-11-27T12:50:17.435 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi115.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-27T12:50:17.472 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:17 +0000 (0:00:00.064) 0:04:52.546 **** 2019-11-27T12:50:17.497 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-27T12:50:17.501 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:17.536 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:17 +0000 (0:00:00.064) 0:04:52.611 **** 2019-11-27T12:50:17.878 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-27T12:50:17.922 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:17 +0000 (0:00:00.386) 0:04:52.997 **** 2019-11-27T12:50:18.259 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-27T12:50:18.260 INFO:teuthology.task.ansible.out:changed: [smithi115.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-27T12:50:18.297 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.375) 0:04:53.372 **** 2019-11-27T12:50:18.327 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-27T12:50:18.328 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.365 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.068) 0:04:53.440 **** 2019-11-27T12:50:18.405 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi115.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.417 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.418 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.428 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.468 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.100) 0:04:53.540 **** 2019-11-27T12:50:18.503 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-27T12:50:18.506 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi115.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.515 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.516 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.528 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.566 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.100) 0:04:53.641 **** 2019-11-27T12:50:18.593 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:50:18.595 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.634 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.067) 0:04:53.709 **** 2019-11-27T12:50:18.661 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.700 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.063) 0:04:53.773 **** 2019-11-27T12:50:18.727 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.765 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.067) 0:04:53.840 **** 2019-11-27T12:50:18.796 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-27T12:50:18.797 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.836 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.067) 0:04:53.908 **** 2019-11-27T12:50:18.863 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-27T12:50:18.865 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:18.911 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.078) 0:04:53.986 **** 2019-11-27T12:50:18.939 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T12:50:18.941 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages via pip] ************************************* ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-27T12:50:18.980 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:18 +0000 (0:00:00.068) 0:04:54.055 **** 2019-11-27T12:50:19.020 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.040) 0:04:54.095 **** 2019-11-27T12:50:19.026 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-27T12:50:19.027 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:19.069 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.047) 0:04:54.142 **** 2019-11-27T12:50:19.074 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-27T12:50:19.074 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:19.117 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.049) 0:04:54.191 **** 2019-11-27T12:50:19.122 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-27T12:50:19.123 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-11-27T12:50:19.164 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.047) 0:04:54.239 **** 2019-11-27T12:50:19.170 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T12:50:19.171 INFO:teuthology.task.ansible.out:skipping: [smithi115.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:19.210 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.045) 0:04:54.285 **** 2019-11-27T12:50:19.470 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-27T12:50:19.472 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-27T12:50:19.511 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.301) 0:04:54.586 **** 2019-11-27T12:50:19.537 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-27T12:50:19.538 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:19.575 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.063) 0:04:54.649 **** 2019-11-27T12:50:19.580 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-27T12:50:19.581 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012740", "end": "2019-11-27 12:50:19.516208", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-27 12:50:19.503468", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:19.603 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi005.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-27T12:50:19.641 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.066) 0:04:54.716 **** 2019-11-27T12:50:19.671 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-27T12:50:19.673 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:19.708 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:19 +0000 (0:00:00.066) 0:04:54.782 **** 2019-11-27T12:50:19.860 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi115.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006706", "end": "2019-11-27 12:50:19.825028", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-27 12:50:19.818322", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:20.027 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-27T12:50:20.029 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-27T12:50:20.065 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.357) 0:04:55.140 **** 2019-11-27T12:50:20.165 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-27T12:50:20.166 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006985", "end": "2019-11-27 12:50:20.126050", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 12:50:20.119065", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:20.382 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-27T12:50:20.384 INFO:teuthology.task.ansible.out:changed: [smithi005.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-27T12:50:20.422 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.357) 0:04:55.497 **** 2019-11-27T12:50:20.448 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-27T12:50:20.450 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.493 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.070) 0:04:55.568 **** 2019-11-27T12:50:20.497 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-27T12:50:20.498 INFO:teuthology.task.ansible.out:ok: [smithi115.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.037283", "end": "2019-11-27 12:50:20.455290", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-27 12:50:20.418007", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:20.542 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.048) 0:04:55.617 **** 2019-11-27T12:50:20.547 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-27T12:50:20.548 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.549 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.559 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.560 INFO:teuthology.task.ansible.out: 2019-11-27T12:50:20.561 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.564 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.599 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.057) 0:04:55.674 **** 2019-11-27T12:50:20.605 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-27T12:50:20.659 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.059) 0:04:55.734 **** 2019-11-27T12:50:20.664 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-27T12:50:20.665 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.667 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.668 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.669 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi005.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.708 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.049) 0:04:55.783 **** 2019-11-27T12:50:20.745 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T12:50:20.746 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.786 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.077) 0:04:55.861 **** 2019-11-27T12:50:20.822 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-27T12:50:20.824 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.861 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.075) 0:04:55.936 **** 2019-11-27T12:50:20.888 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-27T12:50:20.889 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.928 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.066) 0:04:56.003 **** 2019-11-27T12:50:20.954 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-27T12:50:20.956 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:20.997 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:20 +0000 (0:00:00.064) 0:04:56.068 **** 2019-11-27T12:50:21.001 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi115.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T12:50:21.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-27T12:50:21.041 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:21.076 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:21 +0000 (0:00:00.083) 0:04:56.151 **** 2019-11-27T12:50:21.112 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T12:50:21.114 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:21.149 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:21 +0000 (0:00:00.073) 0:04:56.224 **** 2019-11-27T12:50:21.178 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-27T12:50:21.179 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:21.220 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:21 +0000 (0:00:00.068) 0:04:56.293 **** 2019-11-27T12:50:21.245 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T12:50:21.245 INFO:teuthology.task.ansible.out:skipping: [smithi005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T12:50:21.284 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:21 +0000 (0:00:00.065) 0:04:56.359 **** 2019-11-27T12:50:21.635 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi005.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015928", "end": "2019-11-27 12:50:21.597755", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-27 12:50:21.581827", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:21.967 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.008120", "end": "2019-11-27 12:50:21.930747", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-27 12:50:21.922627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:22.289 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007140", "end": "2019-11-27 12:50:22.257198", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 12:50:22.250058", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:23.625 INFO:teuthology.task.ansible.out:ok: [smithi005.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.026543", "end": "2019-11-27 12:50:23.585770", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-27 12:50:22.559227", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T12:50:23.666 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:23 +0000 (0:00:02.382) 0:04:58.741 **** 2019-11-27T12:50:23.693 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-27T12:50:23.733 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:23 +0000 (0:00:00.066) 0:04:58.807 **** 2019-11-27T12:50:24.080 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi005.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T12:50:24.175 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2019-11-27T12:50:24.177 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-11-27T12:50:24.178 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-11-27T12:50:24.180 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi005.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 smithi115.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 2019-11-27T12:50:24.181 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 12:50:24 +0000 (0:00:00.447) 0:04:59.255 **** =============================================================================== 2019-11-27T12:50:24.183 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 37.82s users : Update authorized_keys using the keys repo --------------------- 36.72s common : Update yum cache ---------------------------------------------- 19.52s testnode : Install packages -------------------------------------------- 18.85s users : Remove revoked users -------------------------------------------- 6.73s testnode : Zap all non-root disks --------------------------------------- 4.56s testnode : Ensure ceph packages are not present. ------------------------ 4.36s testnode : Ensure ceph dependency packages are not present. ------------- 3.49s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.86s ansible-managed : Add authorized keys for the ansible user. ------------- 2.70s testnode : List any leftover Ceph artifacts from previous jobs ---------- 2.38s Gathering Facts --------------------------------------------------------- 2.21s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.92s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.91s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.86s common : Upload nagios check_mem script --------------------------------- 1.69s common : Set the hardware clock ----------------------------------------- 1.32s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.24s testnode : Install python-pip on rpm based systems. --------------------- 1.18s testnode : Set a high max open files limit for the teuthology user. ----- 1.08s 2019-11-27T12:50:24.454 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi005.front.sepia.ceph.com')] 2019-11-27T12:50:24.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:50:24.457 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi115.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:50:24.563 INFO:teuthology.orchestra.run.smithi115:> true 2019-11-27T12:50:24.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T12:50:24.937 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi005.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T12:50:25.037 INFO:teuthology.orchestra.run.smithi005:> true 2019-11-27T12:50:25.425 INFO:teuthology.run_tasks:Running task clock... 2019-11-27T12:50:25.439 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-27T12:50:25.440 INFO:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-27T12:50:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-27T12:50:35.669 INFO:teuthology.orchestra.run.smithi115.stdout:ntpd: time slew -0.002889s 2019-11-27T12:50:35.707 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit not found. 2019-11-27T12:50:35.833 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2019-11-27T12:50:35.833 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2019-11-27T12:50:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:35.835 INFO:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-27T12:50:35.980 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-27T12:50:46.073 INFO:teuthology.orchestra.run.smithi005.stdout:ntpd: time slew +0.000242s 2019-11-27T12:50:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit not found. 2019-11-27T12:50:46.201 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2019-11-27T12:50:46.201 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2019-11-27T12:50:46.201 INFO:teuthology.orchestra.run.smithi005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:46.202 INFO:teuthology.orchestra.run.smithi005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:46.202 INFO:teuthology.orchestra.run.smithi005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:46.202 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T12:50:46.203 INFO:teuthology.run_tasks:Running task install... 2019-11-27T12:50:46.213 DEBUG:teuthology.task.install:project ceph 2019-11-27T12:50:46.213 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}} 2019-11-27T12:50:46.213 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'} 2019-11-27T12:50:46.213 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-11-27T12:50:46.218 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-27T12:50:46.218 INFO:teuthology.task.install:extra packages: [] 2019-11-27T12:50:46.218 INFO:teuthology.orchestra.run.smithi115:> sudo lsb_release -is 2019-11-27T12:50:46.379 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS 2019-11-27T12:50:46.381 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T12:50:46.381 INFO:teuthology.orchestra.run.smithi005:> sudo lsb_release -is 2019-11-27T12:50:46.382 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-27T12:50:46.382 INFO:teuthology.orchestra.run.smithi115:> sudo lsb_release -is 2019-11-27T12:50:46.515 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS 2019-11-27T12:50:46.517 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T12:50:46.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:50:46.550 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS 2019-11-27T12:50:46.551 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T12:50:46.551 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-27T12:50:46.551 INFO:teuthology.orchestra.run.smithi005:> sudo lsb_release -is 2019-11-27T12:50:46.670 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mkogan-testing/00732956b62306ff37a7f7c81af9db807aae2dc8/centos/7/flavors/notcmalloc/ 2019-11-27T12:50:46.670 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7725.g0073295 2019-11-27T12:50:46.683 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS 2019-11-27T12:50:46.685 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T12:50:46.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:50:46.786 INFO:teuthology.orchestra.run.smithi115:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-27T12:50:46.833 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mkogan-testing/00732956b62306ff37a7f7c81af9db807aae2dc8/centos/7/flavors/notcmalloc/ 2019-11-27T12:50:46.833 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7725.g0073295 2019-11-27T12:50:46.911 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-27T12:50:46.911 INFO:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/00732956b62306ff37a7f7c81af9db807aae2dc8/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-27T12:50:46.962 INFO:teuthology.orchestra.run.smithi005:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-27T12:50:47.022 INFO:teuthology.orchestra.run.smithi115:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-27T12:50:47.084 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-27T12:50:47.084 INFO:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/00732956b62306ff37a7f7c81af9db807aae2dc8/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-27T12:50:47.110 INFO:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-27T12:50:47.184 INFO:teuthology.orchestra.run.smithi005:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-27T12:50:47.195 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2019-11-27T12:50:47.198 INFO:teuthology.orchestra.run.smithi115:> sudo yum clean all 2019-11-27T12:50:47.270 INFO:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-27T12:50:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2019-11-27T12:50:47.383 INFO:teuthology.orchestra.run.smithi005:> sudo yum clean all 2019-11-27T12:50:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:50:47.469 INFO:teuthology.orchestra.run.smithi115.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-27T12:50:47.469 INFO:teuthology.orchestra.run.smithi115.stdout: : lab-extras updates 2019-11-27T12:50:47.515 INFO:teuthology.orchestra.run.smithi115.stdout:Cleaning up list of fastest mirrors 2019-11-27T12:50:47.515 INFO:teuthology.orchestra.run.smithi115.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-27T12:50:47.528 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw 2019-11-27T12:50:47.607 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:50:47.649 INFO:teuthology.orchestra.run.smithi005.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-27T12:50:47.649 INFO:teuthology.orchestra.run.smithi005.stdout: : lab-extras updates 2019-11-27T12:50:47.693 INFO:teuthology.orchestra.run.smithi005.stdout:Cleaning up list of fastest mirrors 2019-11-27T12:50:47.694 INFO:teuthology.orchestra.run.smithi005.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-27T12:50:47.707 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw 2019-11-27T12:50:47.753 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:50:47.794 INFO:teuthology.orchestra.run.smithi115.stdout:Determining fastest mirrors 2019-11-27T12:50:47.903 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:50:47.943 INFO:teuthology.orchestra.run.smithi005.stdout:Determining fastest mirrors 2019-11-27T12:50:48.297 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:50:48.298 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:50:48.298 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:50:48.299 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:50:48.572 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:50:48.572 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:50:48.573 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:50:48.574 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:51:09.429 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:51:09.778 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:51:09.778 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:09.778 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.791 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.899 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.900 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.902 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.903 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.903 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.905 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.906 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.907 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.908 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:09.908 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.917 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.918 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.919 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.920 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.921 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.922 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.925 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-27T12:51:09.925 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-27T12:51:09.926 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T12:51:09.926 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librados2.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T12:51:09.928 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-27T12:51:09.929 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librgw2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.930 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:09.930 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.935 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.935 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.936 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.937 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.938 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.939 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.940 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.940 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.941 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.942 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.943 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:09.943 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-27T12:51:09.943 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.944 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T12:51:09.944 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librbd1.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T12:51:09.944 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-27T12:51:09.947 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T12:51:09.948 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T12:51:09.948 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:09.948 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-27T12:51:09.948 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.949 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.949 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.949 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.950 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-27T12:51:09.951 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-rados.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.951 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.951 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:09.951 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-27T12:51:10.803 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:51:10.887 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:10.887 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:51:10.890 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:10.890 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:51:10.890 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 6.2 M 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.6 M 2019-11-27T12:51:10.891 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 19 M 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:15.0.0-7725.g0073295.el7 ceph 20 k 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 489 k 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-27T12:51:10.892 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 374 k 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.4 M 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: python-ceph-argparse x86_64 2:15.0.0-7725.g0073295.el7 ceph 35 k 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: python-ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 42 k 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: python-cephfs x86_64 2:15.0.0-7725.g0073295.el7 ceph 102 k 2019-11-27T12:51:10.893 INFO:teuthology.orchestra.run.smithi115.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: python-rados x86_64 2:15.0.0-7725.g0073295.el7 ceph 209 k 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: python-rbd x86_64 2:15.0.0-7725.g0073295.el7 ceph 199 k 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: python-rgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 77 k 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout:Updating for dependencies: 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 3.5 M 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.8 M 2019-11-27T12:51:10.894 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+20 Dependent packages) 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade ( 2 Dependent packages) 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 45 M 2019-11-27T12:51:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:51:10.896 INFO:teuthology.orchestra.run.smithi115.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T12:51:12.807 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:51:13.164 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:51:13.165 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:13.165 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.178 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.292 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.296 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.296 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.296 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.297 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.299 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.311 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.312 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.313 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.315 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.319 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-27T12:51:13.320 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-27T12:51:13.320 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T12:51:13.321 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librados2.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T12:51:13.323 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-27T12:51:13.324 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librgw2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.325 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:13.325 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.329 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.331 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.331 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.332 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.334 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.334 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.335 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.336 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.338 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.338 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.339 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:13.339 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-27T12:51:13.339 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.339 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T12:51:13.340 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librbd1.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T12:51:13.341 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-27T12:51:13.341 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T12:51:13.342 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T12:51:13.343 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:13.343 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-27T12:51:13.344 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.345 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.345 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.345 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.346 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-27T12:51:13.347 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-rados.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.347 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.347 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:13.348 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-27T12:51:14.253 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:51:14.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:14.342 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:51:14.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:14.345 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 6.2 M 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:51:14.346 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.6 M 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 19 M 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:15.0.0-7725.g0073295.el7 ceph 20 k 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 489 k 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-27T12:51:14.347 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 374 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.4 M 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: python-ceph-argparse x86_64 2:15.0.0-7725.g0073295.el7 ceph 35 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: python-ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 42 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: python-cephfs x86_64 2:15.0.0-7725.g0073295.el7 ceph 102 k 2019-11-27T12:51:14.348 INFO:teuthology.orchestra.run.smithi005.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout: python-rados x86_64 2:15.0.0-7725.g0073295.el7 ceph 209 k 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout: python-rbd x86_64 2:15.0.0-7725.g0073295.el7 ceph 199 k 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout: python-rgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 77 k 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout:Updating for dependencies: 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 3.5 M 2019-11-27T12:51:14.349 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.8 M 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+20 Dependent packages) 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade ( 2 Dependent packages) 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 45 M 2019-11-27T12:51:14.350 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:51:14.351 INFO:teuthology.orchestra.run.smithi005.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T12:51:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:51:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:Total 5.9 MB/s | 45 MB 00:07 2019-11-27T12:51:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:51:18.524 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:51:18.837 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:51:18.838 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:51:19.481 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T12:51:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-27T12:51:20.125 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-27T12:51:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T12:51:20.682 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-27T12:51:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 6/25 2019-11-27T12:51:21.345 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-27T12:51:21.578 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T12:51:21.960 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 9/25 2019-11-27T12:51:22.741 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 10/25 2019-11-27T12:51:23.090 INFO:teuthology.orchestra.run.smithi115.stdout: Updating : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 11/25 2019-11-27T12:51:23.970 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T12:51:24.307 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 13/25 2019-11-27T12:51:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T12:51:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: Updating : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T12:51:25.431 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 16/25 2019-11-27T12:51:25.673 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T12:51:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T12:51:26.889 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:51:26.889 INFO:teuthology.orchestra.run.smithi005.stdout:Total 3.6 MB/s | 45 MB 00:12 2019-11-27T12:51:26.905 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:51:26.975 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:51:27.231 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:51:27.232 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:51:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T12:51:28.263 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-27T12:51:28.369 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T12:51:28.601 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-27T12:51:28.875 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T12:51:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-27T12:51:29.465 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 6/25 2019-11-27T12:51:29.481 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T12:51:30.096 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T12:51:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-27T12:51:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T12:51:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 9/25 2019-11-27T12:51:31.736 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 10/25 2019-11-27T12:51:32.068 INFO:teuthology.orchestra.run.smithi005.stdout: Updating : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 11/25 2019-11-27T12:51:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T12:51:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 13/25 2019-11-27T12:51:33.827 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T12:51:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: Updating : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T12:51:34.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 16/25 2019-11-27T12:51:34.702 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T12:51:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T12:51:37.465 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T12:51:38.657 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T12:51:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T12:51:39.429 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T12:51:39.789 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 23/25 2019-11-27T12:51:40.481 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T12:51:40.799 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T12:51:40.919 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T12:51:41.020 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 2/25 2019-11-27T12:51:41.120 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-11-27T12:51:41.213 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T12:51:41.346 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 5/25 2019-11-27T12:51:41.455 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-27T12:51:41.573 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 7/25 2019-11-27T12:51:41.698 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T12:51:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 9/25 2019-11-27T12:51:41.916 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 10/25 2019-11-27T12:51:42.008 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 11/25 2019-11-27T12:51:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T12:51:42.184 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-27T12:51:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T12:51:42.377 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T12:51:42.477 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-11-27T12:51:42.586 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T12:51:42.678 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T12:51:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T12:51:42.929 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T12:51:43.022 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T12:51:43.122 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T12:51:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-27T12:51:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:51:43.630 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-27T12:51:43.631 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-27T12:51:43.632 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.632 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-27T12:51:43.632 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.632 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-27T12:51:43.632 INFO:teuthology.orchestra.run.smithi115.stdout: python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.632 INFO:teuthology.orchestra.run.smithi115.stdout: python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: python-rados.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-27T12:51:43.633 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:43.634 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Updated: 2019-11-27T12:51:43.634 INFO:teuthology.orchestra.run.smithi115.stdout: librados2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.634 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:43.634 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:43.634 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:51:43.745 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-test 2019-11-27T12:51:44.013 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:51:44.051 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:51:44.052 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:51:44.053 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:51:44.053 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:51:44.053 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:51:44.698 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:51:45.019 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:51:45.020 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:45.020 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:45.037 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:45.066 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:45.067 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:45.068 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:45.069 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-27T12:51:45.069 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-27T12:51:45.070 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-27T12:51:45.072 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-27T12:51:45.074 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:51:45.075 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-27T12:51:45.434 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:51:45.654 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:45.654 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:51:45.655 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:15.0.0-7725.g0073295.el7 ceph 38 M 2019-11-27T12:51:45.656 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:51:45.656 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-27T12:51:45.656 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-27T12:51:45.656 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-27T12:51:45.656 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-27T12:51:45.656 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:45.657 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:51:45.657 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:51:45.657 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T12:51:45.657 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:51:45.658 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 38 M 2019-11-27T12:51:45.658 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 134 M 2019-11-27T12:51:45.658 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:51:49.332 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T12:51:49.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 23/25 2019-11-27T12:51:50.019 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T12:51:50.362 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T12:51:50.481 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T12:51:50.590 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 2/25 2019-11-27T12:51:50.691 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-11-27T12:51:50.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T12:51:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 5/25 2019-11-27T12:51:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-27T12:51:51.150 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 7/25 2019-11-27T12:51:51.234 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T12:51:51.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 9/25 2019-11-27T12:51:51.419 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 10/25 2019-11-27T12:51:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 11/25 2019-11-27T12:51:51.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T12:51:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-27T12:51:51.846 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T12:51:51.971 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T12:51:52.080 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-11-27T12:51:52.189 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T12:51:52.281 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T12:51:52.415 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T12:51:52.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T12:51:52.624 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T12:51:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T12:51:52.809 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-27T12:51:52.810 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T12:51:53.184 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T12:51:53.184 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:53.184 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:51:53.184 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.184 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-27T12:51:53.185 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.186 INFO:teuthology.orchestra.run.smithi005.stdout: python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: python-rados.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-27T12:51:53.187 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:53.188 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Updated: 2019-11-27T12:51:53.188 INFO:teuthology.orchestra.run.smithi005.stdout: librados2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.188 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:51:53.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:53.188 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:51:53.314 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-test 2019-11-27T12:51:53.594 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:51:53.636 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:51:53.637 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:51:53.637 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:51:53.637 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:51:53.638 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:51:54.295 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:51:54.638 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:51:54.638 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:54.638 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:51:54.657 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:54.687 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:54.688 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:51:54.689 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:54.690 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-27T12:51:54.690 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-27T12:51:54.691 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-27T12:51:54.693 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-27T12:51:54.696 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:51:54.696 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-27T12:51:55.077 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:51:55.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:55.305 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:51:55.306 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:15.0.0-7725.g0073295.el7 ceph 38 M 2019-11-27T12:51:55.307 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:51:55.308 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:51:55.309 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T12:51:55.309 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:51:55.309 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 38 M 2019-11-27T12:51:55.309 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 134 M 2019-11-27T12:51:55.309 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:52:01.892 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:01.893 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.8 MB/s | 38 MB 00:06 2019-11-27T12:52:01.898 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:52:01.937 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:52:02.041 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:52:02.043 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:52:02.770 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-27T12:52:03.056 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T12:52:03.101 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:03.101 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.2 MB/s | 38 MB 00:17 2019-11-27T12:52:03.106 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:52:03.144 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:52:03.273 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:52:03.273 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:52:03.417 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-27T12:52:03.932 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-27T12:52:04.218 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T12:52:04.529 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-27T12:52:07.624 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-27T12:52:07.926 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T12:52:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-27T12:52:08.109 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T12:52:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 3/5 2019-11-27T12:52:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-27T12:52:08.538 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-27T12:52:08.857 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T12:52:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-27T12:52:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:08.871 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:52:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:08.871 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:52:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-27T12:52:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-27T12:52:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:08.872 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:52:08.964 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-27T12:52:09.007 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph 2019-11-27T12:52:09.064 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T12:52:09.198 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 3/5 2019-11-27T12:52:09.240 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:09.283 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-27T12:52:09.808 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-27T12:52:09.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:09.809 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:52:09.809 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:09.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:09.809 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:52:09.809 INFO:teuthology.orchestra.run.smithi115.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-27T12:52:09.810 INFO:teuthology.orchestra.run.smithi115.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-27T12:52:09.810 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:09.810 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:52:09.942 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph 2019-11-27T12:52:09.964 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:10.204 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:10.248 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:10.249 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:10.250 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:10.250 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:10.250 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:10.308 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:52:10.308 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.309 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:10.311 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.341 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.342 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.343 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.344 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.345 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:10.356 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:10.358 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.359 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.361 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.362 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.363 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.364 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:10.365 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:10.367 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:10.372 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.372 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-27T12:52:10.373 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-27T12:52:10.374 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-27T12:52:10.375 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:10.376 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:10.376 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:10.377 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:10.378 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:10.379 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-27T12:52:10.380 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-27T12:52:10.381 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-27T12:52:10.381 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-27T12:52:10.381 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-27T12:52:10.382 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.382 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-27T12:52:10.383 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T12:52:10.383 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T12:52:10.385 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-27T12:52:10.385 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-27T12:52:10.385 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-27T12:52:10.386 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-27T12:52:10.386 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-27T12:52:10.386 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-27T12:52:10.386 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.387 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-27T12:52:10.387 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-27T12:52:10.387 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-27T12:52:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-27T12:52:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-27T12:52:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-27T12:52:10.769 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:10.893 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:10.999 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:52:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.0 k 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.9 M 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.7 M 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:15.0.0-7725.g0073295.el7 ceph 4.3 M 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:15.0.0-7725.g0073295.el7 ceph 16 M 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-27T12:52:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-27T12:52:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-27T12:52:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-27T12:52:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:11.007 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:52:11.007 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:11.007 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+21 Dependent packages) 2019-11-27T12:52:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:11.008 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 28 M 2019-11-27T12:52:11.008 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 87 M 2019-11-27T12:52:11.008 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:52:11.226 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:52:11.226 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.226 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:11.228 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.257 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.259 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.260 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.261 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.262 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:11.272 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:11.274 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.274 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.276 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.277 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.278 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.279 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:52:11.280 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:11.283 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:11.287 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.287 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-27T12:52:11.288 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-27T12:52:11.289 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-27T12:52:11.289 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:11.290 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:11.291 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:11.292 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:11.293 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T12:52:11.294 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-27T12:52:11.294 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-27T12:52:11.295 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-27T12:52:11.295 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-27T12:52:11.296 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-27T12:52:11.297 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.297 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-27T12:52:11.297 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T12:52:11.298 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T12:52:11.299 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-27T12:52:11.299 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-27T12:52:11.299 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-27T12:52:11.300 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-27T12:52:11.300 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-27T12:52:11.300 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-27T12:52:11.300 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.300 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-27T12:52:11.301 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-27T12:52:11.301 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-27T12:52:11.301 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.302 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-27T12:52:11.302 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-27T12:52:11.302 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:11.302 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-27T12:52:11.660 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:11.880 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:52:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:11.883 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.0 k 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.9 M 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.7 M 2019-11-27T12:52:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:15.0.0-7725.g0073295.el7 ceph 4.3 M 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:15.0.0-7725.g0073295.el7 ceph 16 M 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-27T12:52:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-27T12:52:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-27T12:52:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-27T12:52:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-27T12:52:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-27T12:52:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:11.887 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:52:11.888 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:11.888 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+21 Dependent packages) 2019-11-27T12:52:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:11.889 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 28 M 2019-11-27T12:52:11.889 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 87 M 2019-11-27T12:52:11.889 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:52:15.115 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:15.115 INFO:teuthology.orchestra.run.smithi005.stdout:Total 6.7 MB/s | 28 MB 00:04 2019-11-27T12:52:15.133 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:52:15.166 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:52:15.499 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:52:15.500 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:52:16.184 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:16.185 INFO:teuthology.orchestra.run.smithi115.stdout:Total 6.4 MB/s | 28 MB 00:04 2019-11-27T12:52:16.207 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:52:16.250 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:52:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-27T12:52:16.572 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:52:16.572 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:52:16.700 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-27T12:52:17.324 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-27T12:52:17.484 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-27T12:52:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-27T12:52:17.893 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 4/22 2019-11-27T12:52:18.347 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-27T12:52:18.358 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-27T12:52:18.733 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 4/22 2019-11-27T12:52:18.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-27T12:52:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-27T12:52:19.216 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-27T12:52:19.613 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-27T12:52:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-27T12:52:20.006 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-27T12:52:20.490 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-27T12:52:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-27T12:52:22.196 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 10/22 2019-11-27T12:52:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-27T12:52:22.606 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-11-27T12:52:22.790 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 10/22 2019-11-27T12:52:22.896 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-11-27T12:52:23.153 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-11-27T12:52:23.434 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-27T12:52:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-11-27T12:52:23.866 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T12:52:23.977 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-27T12:52:24.333 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 15/22 2019-11-27T12:52:24.412 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T12:52:24.655 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 16/22 2019-11-27T12:52:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 15/22 2019-11-27T12:52:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-27T12:52:24.988 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 16/22 2019-11-27T12:52:25.208 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-27T12:52:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-27T12:52:25.449 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-27T12:52:25.621 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-27T12:52:25.872 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-27T12:52:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-27T12:52:26.498 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-27T12:52:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T12:52:26.929 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T12:52:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 22/22 2019-11-27T12:52:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-27T12:52:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 22/22 2019-11-27T12:52:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-27T12:52:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-27T12:52:27.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-27T12:52:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-27T12:52:27.520 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-27T12:52:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-27T12:52:27.620 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-27T12:52:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 5/22 2019-11-27T12:52:27.737 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 5/22 2019-11-27T12:52:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-27T12:52:27.846 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-27T12:52:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-27T12:52:27.955 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-27T12:52:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 8/22 2019-11-27T12:52:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 8/22 2019-11-27T12:52:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-11-27T12:52:28.181 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-11-27T12:52:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-11-27T12:52:28.282 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-11-27T12:52:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-27T12:52:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-27T12:52:28.382 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-27T12:52:28.473 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-11-27T12:52:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-27T12:52:28.575 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-11-27T12:52:28.582 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T12:52:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T12:52:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 15/22 2019-11-27T12:52:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 15/22 2019-11-27T12:52:28.849 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 16/22 2019-11-27T12:52:28.918 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 16/22 2019-11-27T12:52:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-27T12:52:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-27T12:52:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-27T12:52:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-27T12:52:29.184 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-27T12:52:29.244 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-27T12:52:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-27T12:52:29.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-27T12:52:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T12:52:29.495 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T12:52:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: ceph.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-27T12:52:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-27T12:52:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-27T12:52:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-27T12:52:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-27T12:52:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-27T12:52:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-27T12:52:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-27T12:52:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-27T12:52:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-27T12:52:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-27T12:52:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:29.877 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:52:29.990 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-27T12:52:29.990 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:29.990 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:52:29.991 INFO:teuthology.orchestra.run.smithi115.stdout: ceph.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.991 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:29.991 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:52:29.991 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.991 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.991 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-27T12:52:29.992 INFO:teuthology.orchestra.run.smithi115.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-27T12:52:29.993 INFO:teuthology.orchestra.run.smithi115.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-27T12:52:29.994 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-27T12:52:29.994 INFO:teuthology.orchestra.run.smithi115.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-27T12:52:29.994 INFO:teuthology.orchestra.run.smithi115.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-27T12:52:29.994 INFO:teuthology.orchestra.run.smithi115.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-27T12:52:29.994 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:29.994 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:52:30.001 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-daemon 2019-11-27T12:52:30.123 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-daemon 2019-11-27T12:52:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:30.347 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:30.386 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:31.018 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:31.021 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:31.342 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:52:31.342 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:31.342 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:31.370 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:52:31.370 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:31.370 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:31.709 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:31.758 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:31.933 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:31.933 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:52:31.934 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:31.934 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:31.934 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:52:31.934 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:52:31.934 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-daemon x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2019-11-27T12:52:31.935 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:31.936 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 17 k 2019-11-27T12:52:31.936 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 67 k 2019-11-27T12:52:31.936 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:52:31.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:31.991 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:52:31.991 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:31.991 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:31.991 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-daemon x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:52:31.992 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:31.993 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2019-11-27T12:52:31.993 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:31.993 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 17 k 2019-11-27T12:52:31.993 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 67 k 2019-11-27T12:52:31.993 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:52:32.495 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:52:32.504 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:52:32.505 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:52:32.506 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:52:32.559 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:52:32.567 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:52:32.569 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:52:32.570 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:52:33.295 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:52:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:52:33.752 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:52:33.752 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:33.752 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:52:33.753 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:33.753 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:33.753 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:52:33.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:52:33.776 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:33.776 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:52:33.776 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:33.777 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:33.777 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:52:33.867 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr 2019-11-27T12:52:33.906 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr 2019-11-27T12:52:34.095 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:34.133 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:34.134 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:34.134 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:34.135 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:34.135 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:34.153 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:34.196 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:34.776 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:34.860 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:35.097 INFO:teuthology.orchestra.run.smithi115.stdout:Package 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:52:35.097 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do 2019-11-27T12:52:35.158 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-dashboard 2019-11-27T12:52:35.207 INFO:teuthology.orchestra.run.smithi005.stdout:Package 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:52:35.208 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do 2019-11-27T12:52:35.269 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-dashboard 2019-11-27T12:52:35.377 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:35.420 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:35.483 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:36.061 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:36.116 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:36.390 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:52:36.391 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:36.391 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:36.394 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:36.423 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:36.424 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:36.424 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:36.424 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-27T12:52:36.424 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-27T12:52:36.425 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:36.425 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-27T12:52:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:52:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:36.460 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:36.492 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:36.492 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:36.492 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:36.492 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-27T12:52:36.493 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-27T12:52:36.493 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:36.493 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-27T12:52:36.786 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:36.881 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:37.008 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:37.009 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 3.9 M 2019-11-27T12:52:37.011 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 18 k 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:37.012 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+3 Dependent packages) 2019-11-27T12:52:37.013 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:37.013 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 4.5 M 2019-11-27T12:52:37.013 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 20 M 2019-11-27T12:52:37.013 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:52:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:37.113 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:52:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:37.114 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 3.9 M 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 18 k 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-27T12:52:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-27T12:52:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:37.116 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:52:37.116 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:37.116 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+3 Dependent packages) 2019-11-27T12:52:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:37.117 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 4.5 M 2019-11-27T12:52:37.117 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 20 M 2019-11-27T12:52:37.117 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:52:39.961 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:39.961 INFO:teuthology.orchestra.run.smithi115.stdout:Total 1.5 MB/s | 4.5 MB 00:02 2019-11-27T12:52:39.966 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:52:39.975 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:52:40.161 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:52:40.161 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:52:41.589 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 1/4 2019-11-27T12:52:41.994 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-27T12:52:43.193 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-27T12:52:43.604 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 4/4 2019-11-27T12:52:43.705 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-27T12:52:43.814 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 2/4 2019-11-27T12:52:43.915 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 3/4 2019-11-27T12:52:44.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-27T12:52:44.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:44.417 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:52:44.417 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:44.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:44.417 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:52:44.418 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:44.418 INFO:teuthology.orchestra.run.smithi115.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-27T12:52:44.418 INFO:teuthology.orchestra.run.smithi115.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-27T12:52:44.418 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:44.418 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:52:44.550 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-27T12:52:44.810 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:44.855 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:44.856 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:44.856 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:44.857 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:44.857 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:45.501 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:45.834 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:52:45.835 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:45.835 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:46.199 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:46.423 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:52:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:46.424 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:52:46.424 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:46.424 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:52:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-cloud 2019-11-27T12:52:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 82 k 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 82 k 2019-11-27T12:52:46.425 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 411 k 2019-11-27T12:52:46.426 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:52:46.732 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:52:46.736 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:52:46.791 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:52:46.791 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:52:47.464 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T12:52:47.885 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T12:52:47.885 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:47.885 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:52:47.886 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:47.886 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:47.886 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:52:48.007 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-27T12:52:48.273 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:48.319 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:48.320 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:48.321 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:48.321 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:48.321 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:49.301 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:52:49.302 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:49.302 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:49.304 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:49.333 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:49.334 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-27T12:52:49.340 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T12:52:49.341 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T12:52:49.344 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T12:52:49.344 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:49.344 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-27T12:52:49.345 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-27T12:52:49.346 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T12:52:49.347 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T12:52:49.348 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:49.348 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-27T12:52:49.708 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:49.931 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:49.932 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:52:49.933 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:49.933 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:49.933 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:52:49.933 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:49.933 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:52:49.933 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 8.6 M 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-27T12:52:49.934 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 19 M 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 104 M 2019-11-27T12:52:49.935 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:52:50.127 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:50.127 INFO:teuthology.orchestra.run.smithi005.stdout:Total 357 kB/s | 4.5 MB 00:13 2019-11-27T12:52:50.133 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:52:50.142 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:52:50.359 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:52:50.399 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:52:50.637 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:52:50.637 INFO:teuthology.orchestra.run.smithi115.stdout:Total 27 MB/s | 19 MB 00:00 2019-11-27T12:52:50.646 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:52:50.670 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:52:50.877 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:52:50.878 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:52:51.271 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 1/4 2019-11-27T12:52:51.701 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-27T12:52:51.799 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 1/5 2019-11-27T12:52:52.279 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T12:52:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-27T12:52:53.287 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 4/4 2019-11-27T12:52:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-27T12:52:53.513 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 2/4 2019-11-27T12:52:53.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 3/4 2019-11-27T12:52:54.073 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 3/5 2019-11-27T12:52:54.150 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-27T12:52:54.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:54.150 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:52:54.150 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:54.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:54.151 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:52:54.151 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:54.151 INFO:teuthology.orchestra.run.smithi005.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-27T12:52:54.151 INFO:teuthology.orchestra.run.smithi005.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-27T12:52:54.151 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:54.151 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:52:54.282 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-27T12:52:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:54.576 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:55.597 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:52:55.598 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:55.598 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-27T12:52:55.984 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:56.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:56.218 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:52:56.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:56.219 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:56.219 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:52:56.219 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:56.219 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-cloud 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 82 k 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2019-11-27T12:52:56.220 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:56.221 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 82 k 2019-11-27T12:52:56.221 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 411 k 2019-11-27T12:52:56.221 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:52:56.523 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:52:56.526 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:52:56.570 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:52:56.571 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:52:56.571 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T12:52:56.667 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-27T12:52:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T12:52:56.860 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-11-27T12:52:56.969 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-27T12:52:57.164 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T12:52:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T12:52:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-27T12:52:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:57.438 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:52:57.552 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-rook 2019-11-27T12:52:57.644 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T12:52:57.645 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:57.645 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:52:57.645 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:52:57.645 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:57.645 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:52:57.769 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-27T12:52:57.807 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:57.850 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:57.851 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:57.851 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:57.851 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:57.852 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:58.004 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:52:58.049 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:52:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:52:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:52:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:52:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:52:58.497 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:58.718 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:52:58.832 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:52:58.832 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:58.832 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:58.834 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:58.863 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:58.864 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-27T12:52:58.866 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:52:58.867 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:52:58.868 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:52:58.869 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:52:58.870 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:58.870 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-27T12:52:58.870 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-27T12:52:58.870 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-27T12:52:58.871 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T12:52:58.872 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T12:52:58.873 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T12:52:58.874 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-27T12:52:58.874 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-27T12:52:58.875 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:58.875 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-27T12:52:58.875 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-27T12:52:58.876 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-27T12:52:58.877 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-27T12:52:58.877 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-27T12:52:58.877 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:52:58.877 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-27T12:52:59.065 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:52:59.066 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:59.066 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:52:59.068 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:52:59.099 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:59.099 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-27T12:52:59.112 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T12:52:59.112 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T12:52:59.112 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T12:52:59.113 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:59.113 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-27T12:52:59.113 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-27T12:52:59.113 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T12:52:59.114 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T12:52:59.114 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:52:59.114 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-27T12:52:59.240 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:59.463 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:59.464 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:52:59.465 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:59.465 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:59.465 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:52:59.465 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:59.466 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:52:59.466 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 24 k 2019-11-27T12:52:59.466 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:52:59.466 INFO:teuthology.orchestra.run.smithi115.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-27T12:52:59.466 INFO:teuthology.orchestra.run.smithi115.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-27T12:52:59.466 INFO:teuthology.orchestra.run.smithi115.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-27T12:52:59.467 INFO:teuthology.orchestra.run.smithi115.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-27T12:52:59.468 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:59.468 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:52:59.468 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:52:59.468 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+10 Dependent packages) 2019-11-27T12:52:59.468 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:52:59.469 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 1.6 M 2019-11-27T12:52:59.469 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 24 M 2019-11-27T12:52:59.469 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:52:59.500 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:52:59.733 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:59.733 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:52:59.734 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:59.735 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:59.735 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:52:59.735 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:59.735 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:52:59.735 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local 2019-11-27T12:52:59.736 INFO:teuthology.orchestra.run.smithi005.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 8.6 M 2019-11-27T12:52:59.736 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:52:59.736 INFO:teuthology.orchestra.run.smithi005.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-27T12:52:59.736 INFO:teuthology.orchestra.run.smithi005.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T12:52:59.737 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:52:59.738 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 19 M 2019-11-27T12:52:59.738 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 104 M 2019-11-27T12:52:59.738 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:53:00.713 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:00.713 INFO:teuthology.orchestra.run.smithi005.stdout:Total 20 MB/s | 19 MB 00:00 2019-11-27T12:53:00.722 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:53:00.746 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:53:00.919 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:53:00.919 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:53:01.699 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 1/5 2019-11-27T12:53:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T12:53:02.789 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:02.789 INFO:teuthology.orchestra.run.smithi115.stdout:Total 507 kB/s | 1.6 MB 00:03 2019-11-27T12:53:02.804 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:53:02.818 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:53:02.923 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:53:02.923 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:53:03.610 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-27T12:53:04.000 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-27T12:53:04.015 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 3/5 2019-11-27T12:53:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-27T12:53:04.610 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-27T12:53:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-27T12:53:05.312 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T12:53:05.674 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-27T12:53:05.706 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-27T12:53:06.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T12:53:06.036 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-27T12:53:06.108 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-27T12:53:06.201 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T12:53:06.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-11-27T12:53:06.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-27T12:53:06.911 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T12:53:06.911 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:06.911 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:53:06.911 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:06.912 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:06.912 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:53:06.912 INFO:teuthology.orchestra.run.smithi005.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-27T12:53:06.912 INFO:teuthology.orchestra.run.smithi005.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-27T12:53:06.912 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:06.912 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:53:07.047 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-rook 2019-11-27T12:53:07.265 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:07.306 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:07.307 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:07.308 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:07.308 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:07.308 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-27T12:53:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-27T12:53:07.976 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:08.014 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 11/11 2019-11-27T12:53:08.121 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-27T12:53:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-27T12:53:08.313 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 3/11 2019-11-27T12:53:08.314 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:53:08.315 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:08.315 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:08.316 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:53:08.347 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:08.348 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-27T12:53:08.350 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:53:08.351 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:53:08.352 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:53:08.353 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T12:53:08.354 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:08.354 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-27T12:53:08.354 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-27T12:53:08.355 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-27T12:53:08.355 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T12:53:08.356 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T12:53:08.357 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T12:53:08.358 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-27T12:53:08.358 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-27T12:53:08.359 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:08.359 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-27T12:53:08.360 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-27T12:53:08.360 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-27T12:53:08.361 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-27T12:53:08.361 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-27T12:53:08.362 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:08.362 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-27T12:53:08.414 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-11-27T12:53:08.514 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-11-27T12:53:08.607 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T12:53:08.699 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 7/11 2019-11-27T12:53:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-11-27T12:53:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-11-27T12:53:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:08.980 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:53:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:08.982 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:53:08.982 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 24 k 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-27T12:53:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:08.984 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:53:08.985 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:08.985 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+10 Dependent packages) 2019-11-27T12:53:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:08.985 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.6 M 2019-11-27T12:53:08.986 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 24 M 2019-11-27T12:53:08.986 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:53:09.050 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-11-27T12:53:09.502 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-27T12:53:09.503 INFO:teuthology.orchestra.run.smithi115.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-27T12:53:09.504 INFO:teuthology.orchestra.run.smithi115.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-27T12:53:09.505 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:09.505 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:53:09.621 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-ssh 2019-11-27T12:53:09.834 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:09.875 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:10.516 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:10.838 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:53:10.839 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:10.839 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:10.841 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:53:10.871 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:10.871 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-27T12:53:10.872 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-27T12:53:10.873 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:10.873 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-27T12:53:10.983 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:10.983 INFO:teuthology.orchestra.run.smithi005.stdout:Total 843 kB/s | 1.6 MB 00:01 2019-11-27T12:53:11.000 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:53:11.014 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:53:11.115 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:53:11.115 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:53:11.238 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:11.462 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:11.462 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:53:11.463 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:11.463 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:11.463 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:53:11.463 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:11.463 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-ssh noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 31 k 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:11.464 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+2 Dependent packages) 2019-11-27T12:53:11.465 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:11.465 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 313 k 2019-11-27T12:53:11.465 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 1.1 M 2019-11-27T12:53:11.465 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:53:11.835 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-27T12:53:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-27T12:53:12.538 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-27T12:53:12.875 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-27T12:53:13.232 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-27T12:53:13.611 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T12:53:13.972 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-27T12:53:14.284 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-27T12:53:14.583 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:14.583 INFO:teuthology.orchestra.run.smithi115.stdout:Total 100 kB/s | 313 kB 00:03 2019-11-27T12:53:14.587 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:53:14.596 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:53:14.677 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:53:14.678 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:53:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-27T12:53:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-27T12:53:15.742 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-27T12:53:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-27T12:53:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 11/11 2019-11-27T12:53:16.238 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T12:53:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-27T12:53:16.334 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-27T12:53:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-27T12:53:16.493 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-27T12:53:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 3/11 2019-11-27T12:53:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-11-27T12:53:16.755 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-11-27T12:53:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T12:53:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 7/11 2019-11-27T12:53:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T12:53:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:16.961 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:53:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:16.962 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:53:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-27T12:53:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:16.962 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:53:16.998 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-11-27T12:53:17.078 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-fuse 2019-11-27T12:53:17.090 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-11-27T12:53:17.182 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-11-27T12:53:17.341 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:17.386 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:17.386 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:17.387 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:17.388 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:17.388 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:17.659 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-11-27T12:53:17.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:17.660 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:53:17.660 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:17.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:17.660 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:53:17.660 INFO:teuthology.orchestra.run.smithi005.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-27T12:53:17.661 INFO:teuthology.orchestra.run.smithi005.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-27T12:53:17.662 INFO:teuthology.orchestra.run.smithi005.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-27T12:53:17.662 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:17.662 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:53:17.791 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-ssh 2019-11-27T12:53:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:18.063 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:18.109 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:18.110 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:18.110 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:18.111 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:18.111 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:53:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:53:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:53:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T12:53:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T12:53:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-27T12:53:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-27T12:53:18.773 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:18.775 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:18.997 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:18.997 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:53:18.998 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 566 k 2019-11-27T12:53:18.999 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:53:19.000 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:19.001 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T12:53:19.001 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:19.001 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 10 M 2019-11-27T12:53:19.001 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 49 M 2019-11-27T12:53:19.001 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:53:19.126 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:53:19.126 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:19.127 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:19.129 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 2019-11-27T12:53:19.160 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:19.160 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-27T12:53:19.160 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-27T12:53:19.161 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:19.161 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-27T12:53:19.549 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:19.566 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:19.566 INFO:teuthology.orchestra.run.smithi115.stdout:Total 18 MB/s | 10 MB 00:00 2019-11-27T12:53:19.583 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:53:19.607 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:53:19.747 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:53:19.747 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:53:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:19.782 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:53:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:19.783 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-ssh noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 31 k 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-27T12:53:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+2 Dependent packages) 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 313 k 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.1 M 2019-11-27T12:53:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:53:22.092 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-27T12:53:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 2/5 2019-11-27T12:53:23.348 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-3.6.8-10.el7.x86_64 3/5 2019-11-27T12:53:23.847 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-27T12:53:24.137 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T12:53:24.235 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 1/5 2019-11-27T12:53:24.344 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-27T12:53:24.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-27T12:53:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-27T12:53:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T12:53:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:24.997 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:53:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:24.998 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:53:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-27T12:53:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-27T12:53:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:24.998 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:53:25.129 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs2 2019-11-27T12:53:25.397 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:25.443 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:25.444 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:25.445 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:25.445 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:25.445 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:26.085 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:26.422 INFO:teuthology.orchestra.run.smithi115.stdout:Package 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:53:26.422 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do 2019-11-27T12:53:26.482 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs-devel 2019-11-27T12:53:26.683 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:26.725 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:26.726 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:26.726 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:26.727 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:26.727 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:27.369 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:27.701 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:53:27.702 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:27.702 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:27.702 INFO:teuthology.orchestra.run.smithi115.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7725.g0073295.el7 for package: 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:53:27.732 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:27.732 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:28.101 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:28.325 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:28.326 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:53:28.326 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:28.326 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:28.327 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:53:28.327 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:53:28.327 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:28.327 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:53:28.327 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T12:53:28.327 INFO:teuthology.orchestra.run.smithi115.stdout:Installing for dependencies: 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 153 k 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package (+1 Dependent package) 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:28.328 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 170 k 2019-11-27T12:53:28.329 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 679 k 2019-11-27T12:53:28.329 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:53:28.692 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:28.692 INFO:teuthology.orchestra.run.smithi115.stdout:Total 465 kB/s | 170 kB 00:00 2019-11-27T12:53:28.695 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:53:28.707 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:53:28.709 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:53:28.710 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:53:29.260 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T12:53:29.479 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T12:53:29.577 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T12:53:30.053 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout:Dependency Installed: 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:30.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:30.055 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:53:30.170 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install librados2 2019-11-27T12:53:30.397 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:30.441 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:31.086 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:31.418 INFO:teuthology.orchestra.run.smithi115.stdout:Package 2:librados2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:53:31.419 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do 2019-11-27T12:53:31.479 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install librbd1 2019-11-27T12:53:31.734 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:31.779 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:31.780 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:31.781 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:31.781 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:31.781 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:32.422 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:32.758 INFO:teuthology.orchestra.run.smithi115.stdout:Package 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:53:32.759 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do 2019-11-27T12:53:32.818 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install python-ceph 2019-11-27T12:53:33.071 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:33.115 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:33.116 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:33.117 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:33.117 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:33.117 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:33.762 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:34.095 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:53:34.096 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:34.096 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:34.465 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:34.690 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout: Size 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:53:34.691 INFO:teuthology.orchestra.run.smithi115.stdout: python-ceph-compat x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.2 k 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.2 k 2019-11-27T12:53:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 0 2019-11-27T12:53:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:53:34.958 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:53:34.959 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:53:34.961 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:53:34.961 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:53:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:53:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:53:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:35.892 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:53:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:35.893 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:53:36.008 INFO:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-fuse 2019-11-27T12:53:36.226 INFO:teuthology.orchestra.run.smithi115.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:36.263 INFO:teuthology.orchestra.run.smithi115.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:36.264 INFO:teuthology.orchestra.run.smithi115.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:36.265 INFO:teuthology.orchestra.run.smithi115.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:36.265 INFO:teuthology.orchestra.run.smithi115.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:36.265 INFO:teuthology.orchestra.run.smithi115.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:36.891 INFO:teuthology.orchestra.run.smithi115.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:37.161 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:37.161 INFO:teuthology.orchestra.run.smithi005.stdout:Total 18 kB/s | 313 kB 00:17 2019-11-27T12:53:37.165 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:53:37.174 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:53:37.211 INFO:teuthology.orchestra.run.smithi115.stdout:Resolving Dependencies 2019-11-27T12:53:37.211 INFO:teuthology.orchestra.run.smithi115.stdout:--> Running transaction check 2019-11-27T12:53:37.211 INFO:teuthology.orchestra.run.smithi115.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:37.277 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:53:37.277 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:53:37.593 INFO:teuthology.orchestra.run.smithi115.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:37.823 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:37.823 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies Resolved 2019-11-27T12:53:37.824 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:37.824 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:37.824 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2019-11-27T12:53:37.824 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:37.824 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2019-11-27T12:53:37.824 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 76 k 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 76 k 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 200 k 2019-11-27T12:53:37.825 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading packages: 2019-11-27T12:53:38.056 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-27T12:53:38.125 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2019-11-27T12:53:38.147 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2019-11-27T12:53:38.149 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded 2019-11-27T12:53:38.150 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2019-11-27T12:53:38.344 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-27T12:53:38.663 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T12:53:38.663 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:53:38.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-27T12:53:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-27T12:53:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:53:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:39.146 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2019-11-27T12:53:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: 2019-11-27T12:53:39.146 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2019-11-27T12:53:39.274 DEBUG:teuthology.parallel:result is None 2019-11-27T12:53:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T12:53:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:39.286 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:53:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:39.287 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:53:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-27T12:53:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:39.287 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:53:39.436 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-fuse 2019-11-27T12:53:39.662 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:39.705 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:40.375 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:40.718 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:53:40.718 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:40.718 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:40.730 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:53:40.763 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:53:40.763 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:40.764 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T12:53:40.764 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:40.766 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:40.767 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:40.768 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-27T12:53:40.768 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:40.769 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T12:53:40.775 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-27T12:53:40.775 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-27T12:53:41.158 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:41.391 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:53:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:41.392 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:53:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:53:41.392 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:41.392 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 566 k 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-27T12:53:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:41.394 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:53:41.394 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:41.394 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T12:53:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:41.395 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 10 M 2019-11-27T12:53:41.395 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 49 M 2019-11-27T12:53:41.395 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:53:42.018 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:42.018 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 10 MB 00:00 2019-11-27T12:53:42.029 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:53:42.045 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:53:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:53:42.192 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:53:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-27T12:53:45.202 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 2/5 2019-11-27T12:53:46.190 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-3.6.8-10.el7.x86_64 3/5 2019-11-27T12:53:46.721 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-27T12:53:46.997 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T12:53:47.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 1/5 2019-11-27T12:53:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-27T12:53:47.331 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-27T12:53:47.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-27T12:53:47.890 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-27T12:53:47.891 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-27T12:53:47.892 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:47.892 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:53:48.020 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs2 2019-11-27T12:53:48.256 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:48.300 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:48.301 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:48.302 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:48.302 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:48.302 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:48.969 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:49.314 INFO:teuthology.orchestra.run.smithi005.stdout:Package 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:53:49.315 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do 2019-11-27T12:53:49.376 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs-devel 2019-11-27T12:53:49.592 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:49.632 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:50.269 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:50.607 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:53:50.607 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:50.607 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:50.608 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7725.g0073295.el7 for package: 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T12:53:50.639 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:50.639 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:51.032 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:51.269 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:53:51.270 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:51.270 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:53:51.270 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:53:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 153 k 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:53:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package (+1 Dependent package) 2019-11-27T12:53:51.272 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 170 k 2019-11-27T12:53:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 679 k 2019-11-27T12:53:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:53:51.622 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T12:53:51.622 INFO:teuthology.orchestra.run.smithi005.stdout:Total 483 kB/s | 170 kB 00:00 2019-11-27T12:53:51.625 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:53:51.636 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:53:51.639 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:53:51.639 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:53:52.204 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T12:53:52.466 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T12:53:52.605 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T12:53:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T12:53:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:53.082 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:53:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:53.082 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T12:53:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:53.083 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:53:53.214 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install librados2 2019-11-27T12:53:53.445 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:53.489 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:54.152 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:54.496 INFO:teuthology.orchestra.run.smithi005.stdout:Package 2:librados2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:53:54.496 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do 2019-11-27T12:53:54.558 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install librbd1 2019-11-27T12:53:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:54.841 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:54.842 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:54.842 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:54.842 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:55.466 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:55.804 INFO:teuthology.orchestra.run.smithi005.stdout:Package 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T12:53:55.804 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do 2019-11-27T12:53:55.866 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install python-ceph 2019-11-27T12:53:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:56.136 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:56.137 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:56.137 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:56.137 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:53:56.758 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:53:57.097 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:53:57.097 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:53:57.098 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:53:57.488 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:53:57.724 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:57.725 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:53:57.725 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout: Size 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout: python-ceph-compat x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.2 k 2019-11-27T12:53:57.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.2 k 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 0 2019-11-27T12:53:57.727 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:53:58.131 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:53:58.132 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:53:58.134 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:53:58.134 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:53:58.602 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:53:59.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:53:59.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:59.052 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:53:59.052 INFO:teuthology.orchestra.run.smithi005.stdout: python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:53:59.053 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:53:59.053 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:53:59.166 INFO:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-fuse 2019-11-27T12:53:59.397 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T12:53:59.440 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T12:53:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T12:53:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T12:53:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T12:53:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T12:54:00.103 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T12:54:00.448 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T12:54:00.448 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T12:54:00.449 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T12:54:00.845 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T12:54:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:54:01.081 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T12:54:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:54:01.082 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:54:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 76 k 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T12:54:01.083 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2019-11-27T12:54:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:54:01.084 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 76 k 2019-11-27T12:54:01.084 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 200 k 2019-11-27T12:54:01.084 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T12:54:01.707 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T12:54:01.730 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T12:54:01.731 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T12:54:01.732 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T12:54:02.255 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:54:02.747 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T12:54:02.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:54:02.747 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T12:54:02.747 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T12:54:02.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:54:02.748 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T12:54:02.876 DEBUG:teuthology.parallel:result is None 2019-11-27T12:54:02.877 INFO:teuthology.orchestra.run.smithi115:> sudo lsb_release -is 2019-11-27T12:54:03.022 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS 2019-11-27T12:54:03.024 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T12:54:03.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:54:03.186 INFO:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-27T12:54:03.325 INFO:teuthology.orchestra.run.smithi115.stdout:15.0.0-7725.g0073295.el7 2019-11-27T12:54:03.326 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7725.g0073295.el7 2019-11-27T12:54:03.326 INFO:teuthology.task.install:The correct ceph version 15.0.0-7725.g0073295 is installed. 2019-11-27T12:54:03.326 INFO:teuthology.orchestra.run.smithi005:> sudo lsb_release -is 2019-11-27T12:54:03.485 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS 2019-11-27T12:54:03.488 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T12:54:03.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:54:03.641 INFO:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-27T12:54:03.774 INFO:teuthology.orchestra.run.smithi005.stdout:15.0.0-7725.g0073295.el7 2019-11-27T12:54:03.775 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7725.g0073295.el7 2019-11-27T12:54:03.775 INFO:teuthology.task.install:The correct ceph version 15.0.0-7725.g0073295 is installed. 2019-11-27T12:54:03.775 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-27T12:54:03.775 INFO:teuthology.orchestra.run.smithi115:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-27T12:54:03.900 INFO:teuthology.orchestra.run.smithi005:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-27T12:54:04.022 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-27T12:54:04.023 INFO:teuthology.orchestra.run.smithi115:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-27T12:54:04.146 INFO:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-27T12:54:04.253 INFO:teuthology.orchestra.run.smithi005:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-27T12:54:04.374 INFO:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-27T12:54:04.465 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-27T12:54:04.466 INFO:teuthology.orchestra.run.smithi115:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-27T12:54:04.589 INFO:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-27T12:54:04.699 INFO:teuthology.orchestra.run.smithi005:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-27T12:54:04.817 INFO:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-27T12:54:04.919 INFO:teuthology.run_tasks:Running task ceph... 2019-11-27T12:54:05.003 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-27T12:54:05.003 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2019-11-27T12:54:05.009 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2019-11-27T12:54:05.128 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-27T12:54:05.128 INFO:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-27T12:54:05.133 INFO:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-27T12:54:05.253 INFO:tasks.ceph:Creating extra log directories... 2019-11-27T12:54:05.253 INFO:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-27T12:54:05.258 INFO:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-27T12:54:05.368 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-27T12:54:05.368 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-11-27T12:54:05.369 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.4303', 'owner': 'scheduled_mkogan@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi005.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSlpCdYla+bRGTwHFT/5m1Gn6qy4SlA5OzOI2XuTGLClT0j9EWByq+IsQRKVqUEPoiaVMiECgYxxPI6QjI1gRbZRXY/EoxNhgWDAPQxH9QSQ5L7Km4cbMvG20cWqHi6FQGHQkJXwtRJPqmsvqt7Bfm/ckqTP/HsY+EtMZRvbSXxg+wuqAu5ZVGj01D9InSm2vXMRjIR4jgLA14s9Tli5REVnlX/p+V21iUXYEucpHwN4OaLuU9y3ouStWrS64bmHG4rt5xzhHJxCfDLUUNGXvxoxZL315FXC7ksdsFDo8n1ZY8W/CsA1yO1fEGbfJfX0jKfYkSPm8LpJG2kF3lW4eB', 'smithi115.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G8pJUeQJ+4OeSI/I3bfmcXvn7cl/bJOqHd7otnxNMNQGIIqE9YYnnl6lvTyaMK8but1WUxB6yvIR+7ibLZc+zq5egb9BUihqste1YlAPJPynDdUReFM7tdUyMZTKiu4xKcli1Vp6CgOIokkNQBGybhHTVBd1GTq/DfKl51iWn9AELXLumAtEYIeKrAbnBf9fly+yzbfm7V/LM58AMLRVscQcCLqdLCoF/zRvujHFyo3qutbU5wnenBBHhJltLee9Fa09yA06P5Z+QomDUWJkT25JxNuXxqEoo1h5xUoUNUUN/VNSXnxRNwkg5dLvD++OCCfDjIYx1aZfIR9FHIOP'}, 'job_id': '4547417', 'tube': 'smithi', 'suite_branch': 'wip-mkogan-testing', 'priority': 90, 'first_in_suite': False, 'branch': 'wip-mkogan-testing', 'suite': 'rgw:verify', 'email': 'mkogan@redhat.com', 'archive_path': '/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547417', 'description': 'rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'name': 'mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'os_type': 'centos', 'overrides': {'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}}, 'rgw': {'frontend': 'civetweb', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'ec-data-pool': False}, 'admin_socket': {'branch': 'wip-mkogan-testing'}, 'workunit': {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'branch': 'wip-mkogan-testing'}}} 2019-11-27T12:54:05.369 INFO:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-27T12:54:05.374 INFO:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-27T12:54:05.456 INFO:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2019-11-27T12:54:05.460 INFO:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2019-11-27T12:54:05.662 DEBUG:teuthology.orchestra.remote:smithi115:/scratch_devs is 72B 2019-11-27T12:54:05.740 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T12:54:05.740 INFO:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-27T12:54:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 105831 Links: 1 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2019-11-27 12:52:26.784124221 +0000 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2019-11-27 12:50:01.163184433 +0000 2019-11-27T12:54:05.809 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2019-11-27 12:50:01.163184433 +0000 2019-11-27T12:54:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2019-11-27T12:54:05.831 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2019-11-27T12:54:05.831 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2019-11-27T12:54:05.831 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes (512 B) copied, 0.00038087 s, 1.3 MB/s 2019-11-27T12:54:05.836 INFO:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-27T12:54:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-27T12:54:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:05.895 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 105863 Links: 1 2019-11-27T12:54:05.895 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:05.895 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:05.896 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2019-11-27 12:52:26.784124221 +0000 2019-11-27T12:54:05.896 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2019-11-27 12:50:01.643174870 +0000 2019-11-27T12:54:05.896 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2019-11-27 12:50:01.643174870 +0000 2019-11-27T12:54:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2019-11-27T12:54:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2019-11-27T12:54:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2019-11-27T12:54:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes (512 B) copied, 0.000306219 s, 1.7 MB/s 2019-11-27T12:54:05.920 INFO:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-27T12:54:05.972 INFO:teuthology.orchestra.run.smithi115.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-27T12:54:05.972 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 105916 Links: 1 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2019-11-27 12:52:26.784124221 +0000 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2019-11-27 12:50:02.137165027 +0000 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2019-11-27 12:50:02.137165027 +0000 2019-11-27T12:54:05.973 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2019-11-27T12:54:05.992 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2019-11-27T12:54:05.992 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2019-11-27T12:54:05.992 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes (512 B) copied, 0.00030036 s, 1.7 MB/s 2019-11-27T12:54:05.996 INFO:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-27T12:54:06.047 INFO:teuthology.orchestra.run.smithi115.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-27T12:54:06.048 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:06.048 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 96205 Links: 1 2019-11-27T12:54:06.048 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:06.048 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:06.048 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2019-11-27 12:52:26.784124221 +0000 2019-11-27T12:54:06.049 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2019-11-27 12:50:02.639155026 +0000 2019-11-27T12:54:06.049 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2019-11-27 12:50:02.639155026 +0000 2019-11-27T12:54:06.049 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2019-11-27T12:54:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2019-11-27T12:54:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2019-11-27T12:54:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes (512 B) copied, 0.000297204 s, 1.7 MB/s 2019-11-27T12:54:06.069 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-27T12:54:06.069 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T12:54:06.069 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-27T12:54:06.069 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:06.164 DEBUG:teuthology.orchestra.remote:smithi005:/scratch_devs is 72B 2019-11-27T12:54:06.258 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T12:54:06.258 INFO:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-27T12:54:06.340 INFO:teuthology.orchestra.run.smithi005.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-27T12:54:06.340 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 105936 Links: 1 2019-11-27T12:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2019-11-27 12:52:26.624225913 +0000 2019-11-27T12:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2019-11-27 12:50:04.559616182 +0000 2019-11-27T12:54:06.342 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2019-11-27 12:50:04.559616182 +0000 2019-11-27T12:54:06.342 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2019-11-27T12:54:06.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2019-11-27T12:54:06.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2019-11-27T12:54:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes (512 B) copied, 0.000345663 s, 1.5 MB/s 2019-11-27T12:54:06.371 INFO:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-27T12:54:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-27T12:54:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:06.445 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 99079 Links: 1 2019-11-27T12:54:06.445 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:06.445 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:06.445 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2019-11-27 12:52:26.624225913 +0000 2019-11-27T12:54:06.445 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2019-11-27 12:50:05.032605321 +0000 2019-11-27T12:54:06.445 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2019-11-27 12:50:05.032605321 +0000 2019-11-27T12:54:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2019-11-27T12:54:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2019-11-27T12:54:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2019-11-27T12:54:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes (512 B) copied, 0.000357561 s, 1.4 MB/s 2019-11-27T12:54:06.472 INFO:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-27T12:54:06.545 INFO:teuthology.orchestra.run.smithi005.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-27T12:54:06.545 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 101024 Links: 1 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2019-11-27 12:52:26.624225913 +0000 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2019-11-27 12:50:05.495594691 +0000 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2019-11-27 12:50:05.495594691 +0000 2019-11-27T12:54:06.546 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2019-11-27T12:54:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2019-11-27T12:54:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2019-11-27T12:54:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes (512 B) copied, 0.000291616 s, 1.8 MB/s 2019-11-27T12:54:06.578 INFO:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-27T12:54:06.648 INFO:teuthology.orchestra.run.smithi005.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-27T12:54:06.648 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T12:54:06.648 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 99158 Links: 1 2019-11-27T12:54:06.648 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T12:54:06.649 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T12:54:06.649 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2019-11-27 12:52:26.624225913 +0000 2019-11-27T12:54:06.649 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2019-11-27 12:50:05.978583601 +0000 2019-11-27T12:54:06.649 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2019-11-27 12:50:05.978583601 +0000 2019-11-27T12:54:06.649 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2019-11-27T12:54:06.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2019-11-27T12:54:06.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2019-11-27T12:54:06.678 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes (512 B) copied, 0.000321708 s, 1.6 MB/s 2019-11-27T12:54:06.683 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-27T12:54:06.683 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T12:54:06.683 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-27T12:54:06.684 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:06.684 INFO:tasks.ceph:Generating config... 2019-11-27T12:54:06.685 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-11-27T12:54:06.685 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-11-27T12:54:06.685 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-11-27T12:54:06.685 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-11-27T12:54:06.686 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] osd objectstore = filestore 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] osd sloppy crc = True 2019-11-27T12:54:06.686 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-27T12:54:06.687 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-27T12:54:06.687 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-27T12:54:06.687 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-27T12:54:06.687 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-11-27T12:54:06.687 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-27T12:54:06.687 INFO:tasks.ceph:[client] debug rgw = 20 2019-11-27T12:54:06.687 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-11-27T12:54:06.687 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-11-27T12:54:06.688 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-11-27T12:54:06.688 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-11-27T12:54:06.688 INFO:tasks.ceph:Setting up mon.a... 2019-11-27T12:54:06.689 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-27T12:54:06.824 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2019-11-27T12:54:06.829 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-27T12:54:06.961 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-27T12:54:07.072 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.c', '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]'), ('mon.b', '172.21.15.115')] 2019-11-27T12:54:07.072 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.5 --addv c '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]' --add b 172.21.15.115 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:07.213 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:07.213 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 221e92ee-02f5-4189-a8d9-8c2cce99ef81 2019-11-27T12:54:07.213 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2019-11-27T12:54:07.213 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 221e92ee-02f5-4189-a8d9-8c2cce99ef81 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2019-11-27T12:54:07.192686+0000 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:created 2019-11-27T12:54:07.192686+0000 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 0 (unknown) 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2019-11-27T12:54:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-27T12:54:07.215 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 221e92ee-02f5-4189-a8d9-8c2cce99ef81... 2019-11-27T12:54:07.216 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-27T12:54:07.221 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-27T12:54:07.440 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-27T12:54:07.440 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-27T12:54:07.586 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-27T12:54:07.662 DEBUG:teuthology.orchestra.remote:smithi005:/etc/ceph/ceph.keyring is 206B 2019-11-27T12:54:07.837 DEBUG:teuthology.orchestra.remote:smithi005:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-27T12:54:07.926 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:54:07.926 INFO:teuthology.orchestra.run.smithi115:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-27T12:54:08.070 INFO:teuthology.orchestra.run.smithi115:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:08.140 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:54:08.140 INFO:teuthology.orchestra.run.smithi005:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-27T12:54:08.288 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:08.362 INFO:tasks.ceph:Setting up mon nodes... 2019-11-27T12:54:08.362 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-27T12:54:08.362 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-27T12:54:08.558 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-27T12:54:08.563 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-27T12:54:08.719 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-27T12:54:08.723 INFO:tasks.ceph:Setting up mds nodes... 2019-11-27T12:54:08.724 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-27T12:54:08.724 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-27T12:54:08.863 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-27T12:54:08.896 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-27T12:54:09.048 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-27T12:54:09.080 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-27T12:54:09.080 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2019-11-27T12:54:09.080 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-27T12:54:09.195 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:09.195 INFO:tasks.ceph:{} 2019-11-27T12:54:09.195 INFO:tasks.ceph:osd.4 2019-11-27T12:54:09.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:54:09.195 INFO:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-27T12:54:09.799 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:09.799 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:09.799 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:09.799 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:09.799 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:09.800 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:09.800 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:09.800 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:09.800 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:09.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2019-11-27T12:54:09.802 INFO:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-27T12:54:09.993 INFO:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-27T12:54:10.102 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-27T12:54:10.203 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:10.203 INFO:tasks.ceph:{} 2019-11-27T12:54:10.204 INFO:tasks.ceph:osd.5 2019-11-27T12:54:10.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:54:10.204 INFO:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-27T12:54:10.774 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:10.775 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:10.775 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:10.775 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:10.776 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:10.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2019-11-27T12:54:10.777 INFO:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-27T12:54:10.939 INFO:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-27T12:54:11.030 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-27T12:54:11.109 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:11.109 INFO:tasks.ceph:{} 2019-11-27T12:54:11.109 INFO:tasks.ceph:osd.6 2019-11-27T12:54:11.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:54:11.110 INFO:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-27T12:54:11.672 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:11.673 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:11.673 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:11.673 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:11.673 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:11.673 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:11.673 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:11.674 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:11.674 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:11.675 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2019-11-27T12:54:11.675 INFO:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-27T12:54:11.846 INFO:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-27T12:54:11.958 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-27T12:54:12.041 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:12.041 INFO:tasks.ceph:{} 2019-11-27T12:54:12.042 INFO:tasks.ceph:osd.7 2019-11-27T12:54:12.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T12:54:12.042 INFO:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-27T12:54:12.563 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:12.563 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:12.564 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:12.564 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:12.564 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:12.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2019-11-27T12:54:12.565 INFO:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-27T12:54:12.662 INFO:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-27T12:54:12.733 INFO:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:12.830 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.831+0000 7fbe3cdd0b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-27T12:54:12.831 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.831+0000 7fbe3cdd0b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-27T12:54:12.842 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.843+0000 7fbe3cdd0b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:12.842 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.843+0000 7fbe3cdd0b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:12.990 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.991+0000 7fbe3cdd0b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:12.990 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.991+0000 7fbe3cdd0b40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:12.990 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:12.991+0000 7fbe3cdd0b40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:13.003 INFO:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-27T12:54:13.103 INFO:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:13.251 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.251+0000 7f265ee44b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-27T12:54:13.251 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.252+0000 7f265ee44b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-27T12:54:13.266 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.267+0000 7f265ee44b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:13.267 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.267+0000 7f265ee44b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:13.408 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.408+0000 7f265ee44b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:13.408 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.408+0000 7f265ee44b40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:13.408 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.408+0000 7f265ee44b40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:13.421 INFO:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-27T12:54:13.528 INFO:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.682+0000 7f9c10a1ab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-27T12:54:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.683+0000 7f9c10a1ab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-27T12:54:13.698 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.699+0000 7f9c10a1ab40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:13.698 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.699+0000 7f9c10a1ab40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:13.848 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.848+0000 7f9c10a1ab40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:13.848 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.848+0000 7f9c10a1ab40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:13.848 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:13.848+0000 7f9c10a1ab40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:13.864 INFO:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-27T12:54:13.977 INFO:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:14.121 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.122+0000 7f2caf6dfb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-27T12:54:14.122 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.122+0000 7f2caf6dfb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-27T12:54:14.136 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.137+0000 7f2caf6dfb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:14.136 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.137+0000 7f2caf6dfb40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:14.280 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.281+0000 7f2caf6dfb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:14.280 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.281+0000 7f2caf6dfb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:14.281 INFO:teuthology.orchestra.run.smithi115.stderr:2019-11-27T12:54:14.281+0000 7f2caf6dfb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:14.293 INFO:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-27T12:54:14.382 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-27T12:54:14.506 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:14.506 INFO:tasks.ceph:{} 2019-11-27T12:54:14.506 INFO:tasks.ceph:osd.0 2019-11-27T12:54:14.506 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:54:14.506 INFO:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-27T12:54:14.651 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:14.651 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:14.652 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:14.652 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:14.652 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:14.652 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:14.654 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2019-11-27T12:54:14.654 INFO:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-27T12:54:14.782 INFO:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-27T12:54:14.869 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-27T12:54:14.943 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:14.943 INFO:tasks.ceph:{} 2019-11-27T12:54:14.943 INFO:tasks.ceph:osd.1 2019-11-27T12:54:14.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:54:14.944 INFO:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-27T12:54:15.051 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:15.051 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:15.051 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:15.052 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:15.052 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:15.052 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:15.052 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:15.052 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:15.052 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:15.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2019-11-27T12:54:15.053 INFO:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-27T12:54:15.175 INFO:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-27T12:54:15.271 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-27T12:54:15.374 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:15.375 INFO:tasks.ceph:{} 2019-11-27T12:54:15.375 INFO:tasks.ceph:osd.2 2019-11-27T12:54:15.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:54:15.376 INFO:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-27T12:54:15.512 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:15.513 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:15.513 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:15.514 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:15.514 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:15.515 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2019-11-27T12:54:15.516 INFO:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-27T12:54:15.644 INFO:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-27T12:54:15.754 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-27T12:54:15.855 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T12:54:15.856 INFO:tasks.ceph:{} 2019-11-27T12:54:15.856 INFO:tasks.ceph:osd.3 2019-11-27T12:54:15.856 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T12:54:15.856 INFO:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-27T12:54:15.971 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T12:54:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T12:54:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T12:54:15.972 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T12:54:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2019-11-27T12:54:15.973 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T12:54:15.973 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T12:54:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T12:54:15.974 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T12:54:15.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2019-11-27T12:54:15.975 INFO:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-27T12:54:16.076 INFO:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-27T12:54:16.157 INFO:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:16.296 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.276+0000 7f2ded75bb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-27T12:54:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.277+0000 7f2ded75bb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-27T12:54:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.289+0000 7f2ded75bb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.289+0000 7f2ded75bb40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.356+0000 7f2ded75bb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.356+0000 7f2ded75bb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.356+0000 7f2ded75bb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:16.387 INFO:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-27T12:54:16.472 INFO:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:16.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.554+0000 7f1d912bcb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-27T12:54:16.575 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.555+0000 7f1d912bcb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-27T12:54:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.565+0000 7f1d912bcb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.565+0000 7f1d912bcb40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:16.648 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.628+0000 7f1d912bcb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:16.648 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.628+0000 7f1d912bcb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:16.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.628+0000 7f1d912bcb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:16.657 INFO:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-27T12:54:16.724 INFO:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:16.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.793+0000 7f54826a3b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-27T12:54:16.814 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.794+0000 7f54826a3b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-27T12:54:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.802+0000 7f54826a3b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.802+0000 7f54826a3b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.861+0000 7f54826a3b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.861+0000 7f54826a3b40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:16.861+0000 7f54826a3b40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:16.889 INFO:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-27T12:54:16.957 INFO:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.021+0000 7f11c5cdbb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-27T12:54:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.022+0000 7f11c5cdbb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-27T12:54:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.029+0000 7f11c5cdbb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.029+0000 7f11c5cdbb40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-27T12:54:17.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.090+0000 7f11c5cdbb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:17.111 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.091+0000 7f11c5cdbb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:17.111 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:17.091+0000 7f11c5cdbb40 -1 journal do_read_entry(4096): bad header magic 2019-11-27T12:54:17.119 INFO:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-27T12:54:17.183 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-27T12:54:17.183 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:17.275 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.RglnkNzFYF 2019-11-27T12:54:17.276 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.RglnkNzFYF 2019-11-27T12:54:17.386 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.RglnkNzFYF 2019-11-27T12:54:17.578 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.RglnkNzFYF is 56B 2019-11-27T12:54:17.658 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.RglnkNzFYF 2019-11-27T12:54:17.728 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:17.794 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.M7y3eAoiFc 2019-11-27T12:54:17.794 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.M7y3eAoiFc 2019-11-27T12:54:17.872 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.M7y3eAoiFc 2019-11-27T12:54:18.006 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.M7y3eAoiFc is 56B 2019-11-27T12:54:18.073 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.M7y3eAoiFc 2019-11-27T12:54:18.136 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.ysKN9CC1o2 2019-11-27T12:54:18.194 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.ysKN9CC1o2 2019-11-27T12:54:18.265 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.ysKN9CC1o2 2019-11-27T12:54:18.387 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.ysKN9CC1o2 is 56B 2019-11-27T12:54:18.444 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.ysKN9CC1o2 2019-11-27T12:54:18.493 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:18.628 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.i9zoTDUjhS 2019-11-27T12:54:18.629 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.i9zoTDUjhS 2019-11-27T12:54:18.736 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.i9zoTDUjhS 2019-11-27T12:54:18.897 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.i9zoTDUjhS is 56B 2019-11-27T12:54:18.962 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.i9zoTDUjhS 2019-11-27T12:54:19.026 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:19.174 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.oJBNyMh2OW 2019-11-27T12:54:19.174 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.oJBNyMh2OW 2019-11-27T12:54:19.287 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.oJBNyMh2OW 2019-11-27T12:54:19.474 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.oJBNyMh2OW is 56B 2019-11-27T12:54:19.550 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.oJBNyMh2OW 2019-11-27T12:54:19.614 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:19.711 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.h6gWOI3Ehe 2019-11-27T12:54:19.712 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.h6gWOI3Ehe 2019-11-27T12:54:19.825 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.h6gWOI3Ehe 2019-11-27T12:54:20.031 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.h6gWOI3Ehe is 56B 2019-11-27T12:54:20.115 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.h6gWOI3Ehe 2019-11-27T12:54:20.188 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:20.256 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.8npxb29bvV 2019-11-27T12:54:20.257 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.8npxb29bvV 2019-11-27T12:54:20.350 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.8npxb29bvV 2019-11-27T12:54:20.523 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.8npxb29bvV is 56B 2019-11-27T12:54:20.593 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.8npxb29bvV 2019-11-27T12:54:20.656 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:20.712 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.LBb1zPBYnp 2019-11-27T12:54:20.713 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.LBb1zPBYnp 2019-11-27T12:54:20.793 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.LBb1zPBYnp 2019-11-27T12:54:20.945 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.LBb1zPBYnp is 56B 2019-11-27T12:54:21.016 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.LBb1zPBYnp 2019-11-27T12:54:21.077 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:21.136 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.T5RGDia5dl 2019-11-27T12:54:21.137 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.T5RGDia5dl 2019-11-27T12:54:21.215 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.T5RGDia5dl 2019-11-27T12:54:21.351 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.T5RGDia5dl is 56B 2019-11-27T12:54:21.414 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.T5RGDia5dl 2019-11-27T12:54:21.471 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:21.527 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.0suL1Azl1E 2019-11-27T12:54:21.528 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.0suL1Azl1E 2019-11-27T12:54:21.605 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.0suL1Azl1E 2019-11-27T12:54:21.742 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.0suL1Azl1E is 56B 2019-11-27T12:54:21.808 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.0suL1Azl1E 2019-11-27T12:54:21.962 DEBUG:teuthology.orchestra.remote:smithi115:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-27T12:54:22.127 DEBUG:teuthology.orchestra.remote:smithi005:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-27T12:54:22.212 INFO:tasks.ceph:Adding keys to all mons... 2019-11-27T12:54:22.212 INFO:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-27T12:54:22.218 INFO:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-27T12:54:22.329 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2019-11-27T12:54:22.329 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDwcd5dwBxqIRAAV6vsvgm44m9wG6/6D7KLPQ== 2019-11-27T12:54:22.329 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2019-11-27T12:54:22.329 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD0cd5dFi+cMRAAKXz/WC53sPRXsoQA14pVkA== 2019-11-27T12:54:22.329 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2019-11-27T12:54:22.329 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD1cd5dnP0ODxAA026JK0lQ9lt8HxlIC/fpeQ== 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD1cd5db83CKBAAQODXRVCBJk8muVXhRPEf8w== 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD2cd5dC51aBxAAF/dhgMW45LolY7JsNnzAGA== 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDwcd5d42rGKRAAWJ3VjCzBeKz0pg1ye42LZQ== 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2019-11-27T12:54:22.330 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD4cd5dq0eUEBAASBOJv48Jec6rfeo7NH//Mw== 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD4cd5dcUUnIRAAfHkQ089lsxxlxxFmh6K8Xg== 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD4cd5dDYJlLxAAMs4Z69EJUJ75S4qTLXXSQA== 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD5cd5dq8NlARAAasUQecIECq5C8d1luWUy7Q== 2019-11-27T12:54:22.331 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2019-11-27T12:54:22.332 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDwcd5d1QeOMxAAytpnSSYuTXbdIWf7BAAvcA== 2019-11-27T12:54:22.332 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2019-11-27T12:54:22.332 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDxcd5d+/nHARAAROnEEOcsqoRDURJhgvpvCA== 2019-11-27T12:54:22.333 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDwcd5dwBxqIRAAV6vsvgm44m9wG6/6D7KLPQ== 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD0cd5dFi+cMRAAKXz/WC53sPRXsoQA14pVkA== 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD1cd5dnP0ODxAA026JK0lQ9lt8HxlIC/fpeQ== 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD1cd5db83CKBAAQODXRVCBJk8muVXhRPEf8w== 2019-11-27T12:54:22.334 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD2cd5dC51aBxAAF/dhgMW45LolY7JsNnzAGA== 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDwcd5d42rGKRAAWJ3VjCzBeKz0pg1ye42LZQ== 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD4cd5dq0eUEBAASBOJv48Jec6rfeo7NH//Mw== 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2019-11-27T12:54:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD4cd5dcUUnIRAAfHkQ089lsxxlxxFmh6K8Xg== 2019-11-27T12:54:22.336 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2019-11-27T12:54:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD4cd5dDYJlLxAAMs4Z69EJUJ75S4qTLXXSQA== 2019-11-27T12:54:22.336 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2019-11-27T12:54:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQD5cd5dq8NlARAAasUQecIECq5C8d1luWUy7Q== 2019-11-27T12:54:22.337 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2019-11-27T12:54:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDwcd5d1QeOMxAAytpnSSYuTXbdIWf7BAAvcA== 2019-11-27T12:54:22.337 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2019-11-27T12:54:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDxcd5d+/nHARAAROnEEOcsqoRDURJhgvpvCA== 2019-11-27T12:54:22.338 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T12:54:22.347 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T12:54:22.513 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:22.517 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:22.685 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:22.689 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:22.850 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:22.855 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.021 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.031 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.184 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T12:54:23.189 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T12:54:23.352 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.357 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.530 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.535 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.710 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.715 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.884 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:23.889 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T12:54:24.059 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T12:54:24.064 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T12:54:24.239 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T12:54:24.244 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T12:54:24.424 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-27T12:54:24.425 INFO:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-27T12:54:24.548 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-27T12:54:24.723 INFO:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-27T12:54:24.841 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-27T12:54:24.963 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-27T12:54:25.138 INFO:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-27T12:54:25.240 INFO:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-27T12:54:25.334 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-27T12:54:25.468 INFO:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-27T12:54:25.579 INFO:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:25.583 INFO:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-27T12:54:25.675 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-27T12:54:25.676 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-27T12:54:25.676 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-27T12:54:25.676 INFO:teuthology.orchestra.run.smithi115:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-11-27T12:54:25.681 INFO:tasks.ceph.mon.b:Started 2019-11-27T12:54:25.681 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-27T12:54:25.682 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-27T12:54:25.682 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-11-27T12:54:25.686 INFO:tasks.ceph.mon.a:Started 2019-11-27T12:54:25.686 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-27T12:54:25.687 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-27T12:54:25.687 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-11-27T12:54:25.691 INFO:tasks.ceph.mon.c:Started 2019-11-27T12:54:25.691 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-27T12:54:25.691 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-27T12:54:25.691 INFO:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-11-27T12:54:25.695 INFO:tasks.ceph.mgr.x:Started 2019-11-27T12:54:25.696 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-27T12:54:25.696 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-11-27T12:54:25.700 INFO:tasks.ceph.mgr.y:Started 2019-11-27T12:54:25.700 INFO:tasks.ceph:Setting crush tunables to default 2019-11-27T12:54:25.700 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2019-11-27T12:54:29.854 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:00:03.867 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:29.890 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:00:04.041 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:29.916 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:00:04.068 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2019-11-27T12:54:37.524 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-27T12:54:37.524 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:37.594 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.fWQUal8emf 2019-11-27T12:54:37.595 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.fWQUal8emf 2019-11-27T12:54:37.669 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.fWQUal8emf 2019-11-27T12:54:37.776 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.fWQUal8emf is 37B 2019-11-27T12:54:37.824 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.fWQUal8emf 2019-11-27T12:54:37.866 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:37.994 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.lh1EJ42hXH 2019-11-27T12:54:37.995 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.lh1EJ42hXH 2019-11-27T12:54:38.059 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.lh1EJ42hXH 2019-11-27T12:54:38.164 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.lh1EJ42hXH is 37B 2019-11-27T12:54:38.211 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.lh1EJ42hXH 2019-11-27T12:54:38.254 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:38.364 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.muFoI0YEY0 2019-11-27T12:54:38.365 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.muFoI0YEY0 2019-11-27T12:54:38.423 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.muFoI0YEY0 2019-11-27T12:54:38.521 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.muFoI0YEY0 is 37B 2019-11-27T12:54:38.567 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.muFoI0YEY0 2019-11-27T12:54:38.613 INFO:teuthology.orchestra.run.smithi115:> mktemp 2019-11-27T12:54:38.729 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.oybsrh3pmk 2019-11-27T12:54:38.730 INFO:teuthology.orchestra.run.smithi115:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.oybsrh3pmk 2019-11-27T12:54:38.794 INFO:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.oybsrh3pmk 2019-11-27T12:54:38.898 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.oybsrh3pmk is 37B 2019-11-27T12:54:38.945 INFO:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.oybsrh3pmk 2019-11-27T12:54:38.985 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:39.075 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.WRZkaiDJLW 2019-11-27T12:54:39.075 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.WRZkaiDJLW 2019-11-27T12:54:39.171 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.WRZkaiDJLW 2019-11-27T12:54:39.291 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.WRZkaiDJLW is 37B 2019-11-27T12:54:39.342 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.WRZkaiDJLW 2019-11-27T12:54:39.388 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:39.504 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.N8eADrotGh 2019-11-27T12:54:39.504 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.N8eADrotGh 2019-11-27T12:54:39.569 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.N8eADrotGh 2019-11-27T12:54:39.676 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.N8eADrotGh is 37B 2019-11-27T12:54:39.724 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.N8eADrotGh 2019-11-27T12:54:39.772 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:39.903 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.zH2wFMTnLW 2019-11-27T12:54:39.904 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.zH2wFMTnLW 2019-11-27T12:54:39.962 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.zH2wFMTnLW 2019-11-27T12:54:40.080 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.zH2wFMTnLW is 37B 2019-11-27T12:54:40.157 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.zH2wFMTnLW 2019-11-27T12:54:40.228 INFO:teuthology.orchestra.run.smithi005:> mktemp 2019-11-27T12:54:40.379 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.KVsNE7CX2W 2019-11-27T12:54:40.379 INFO:teuthology.orchestra.run.smithi005:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.KVsNE7CX2W 2019-11-27T12:54:40.474 INFO:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.KVsNE7CX2W 2019-11-27T12:54:40.599 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.KVsNE7CX2W is 37B 2019-11-27T12:54:40.656 INFO:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.KVsNE7CX2W 2019-11-27T12:54:40.708 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new 3d919c64-aa4e-4484-a16a-daa2fc22c750 0 2019-11-27T12:54:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:54:41.214+0000 7f59c8e01700 0 --2- 172.21.15.5:0/1276748614 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f59c4063930 0x7f59c4062cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T12:54:42.358 INFO:teuthology.orchestra.run.smithi005.stdout:0 2019-11-27T12:54:42.378 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new 4ca7dbbc-1f03-4470-8ef2-39e405978813 1 2019-11-27T12:54:43.437 INFO:teuthology.orchestra.run.smithi005.stdout:1 2019-11-27T12:54:43.457 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new 53957d07-b094-418a-8b35-207001a956cf 2 2019-11-27T12:54:44.471 INFO:teuthology.orchestra.run.smithi005.stdout:2 2019-11-27T12:54:44.488 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new eca5baf0-831c-4706-99b5-e0d0cca20ab8 3 2019-11-27T12:54:45.390 INFO:teuthology.orchestra.run.smithi005.stdout:3 2019-11-27T12:54:45.409 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new 27394721-952d-4796-8c83-1b87a2336d0e 4 2019-11-27T12:54:46.292 INFO:teuthology.orchestra.run.smithi005.stdout:4 2019-11-27T12:54:46.310 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new 04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd 5 2019-11-27T12:54:47.409 INFO:teuthology.orchestra.run.smithi005.stdout:5 2019-11-27T12:54:47.429 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc 6 2019-11-27T12:54:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:6 2019-11-27T12:54:48.484 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd new 6808852a-284d-48fd-a385-2757bc941376 7 2019-11-27T12:54:49.404 INFO:teuthology.orchestra.run.smithi005.stdout:7 2019-11-27T12:54:49.425 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.425 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-27T12:54:49.425 INFO:teuthology.orchestra.run.smithi115:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-11-27T12:54:49.430 INFO:tasks.ceph.osd.4:Started 2019-11-27T12:54:49.430 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.430 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-27T12:54:49.430 INFO:teuthology.orchestra.run.smithi115:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-11-27T12:54:49.434 INFO:tasks.ceph.osd.5:Started 2019-11-27T12:54:49.435 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.435 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-27T12:54:49.435 INFO:teuthology.orchestra.run.smithi115:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-11-27T12:54:49.439 INFO:tasks.ceph.osd.6:Started 2019-11-27T12:54:49.439 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.439 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-27T12:54:49.439 INFO:teuthology.orchestra.run.smithi115:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-11-27T12:54:49.443 INFO:tasks.ceph.osd.7:Started 2019-11-27T12:54:49.443 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.443 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-27T12:54:49.444 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-11-27T12:54:49.448 INFO:tasks.ceph.osd.0:Started 2019-11-27T12:54:49.448 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.448 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-27T12:54:49.448 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-11-27T12:54:49.452 INFO:tasks.ceph.osd.1:Started 2019-11-27T12:54:49.453 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.453 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-27T12:54:49.453 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-11-27T12:54:49.457 INFO:tasks.ceph.osd.2:Started 2019-11-27T12:54:49.457 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T12:54:49.457 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-27T12:54:49.457 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-11-27T12:54:49.461 INFO:tasks.ceph.osd.3:Started 2019-11-27T12:54:49.462 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-27T12:54:50.269 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-27T12:54:51.151 INFO:teuthology.misc.health.smithi005.stdout: 2019-11-27T12:54:51.151 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"221e92ee-02f5-4189-a8d9-8c2cce99ef81","created":"2019-11-27T12:54:34.236835+0000","modified":"2019-11-27T12:54:49.199280+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"3d919c64-aa4e-4484-a16a-daa2fc22c750","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ca7dbbc-1f03-4470-8ef2-39e405978813","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53957d07-b094-418a-8b35-207001a956cf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eca5baf0-831c-4706-99b5-e0d0cca20ab8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27394721-952d-4796-8c83-1b87a2336d0e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6808852a-284d-48fd-a385-2757bc941376","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T12:54:51.168 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-27T12:54:53.214 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T12:54:53.204+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:53.389 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T12:54:53.359+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:53.401 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T12:54:53.368+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:53.416 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T12:54:53.404+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:54.146 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T12:54:54.137+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:54.210 INFO:tasks.ceph.osd.6.smithi115.stderr:==00:00:00:04.649 9159== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:54.251 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:54:54.241+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:54.303 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T12:54:54.267+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:54.309 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:04.751 10036== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:54.342 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T12:54:54.311+0000 9b10800 -1 Falling back to public interface 2019-11-27T12:54:54.370 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:04.779 10044== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:54.421 INFO:tasks.ceph.osd.4.smithi115.stderr:==00:00:00:04.860 9157== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:54.586 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T12:54:54.573+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:54.601 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T12:54:54.588+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.610 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T12:54:54.592+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.715 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T12:54:54.687+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:54.772 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T12:54:54.711+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.777 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T12:54:54.715+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.779 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T12:54:54.750+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:54.784 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T12:54:54.777+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:54.828 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T12:54:54.774+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.835 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T12:54:54.779+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.865 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T12:54:54.800+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:54.868 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T12:54:54.805+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.135 INFO:tasks.ceph.osd.7.smithi115.stderr:==00:00:00:05.591 9156== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:55.175 INFO:tasks.ceph.osd.5.smithi115.stderr:==00:00:00:05.615 9158== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:55.187 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T12:54:55.185+0000 9b10800 -1 osd.6 0 log_to_monitors {default=true} 2019-11-27T12:54:55.226 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:05.635 10045== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:55.285 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T12:54:55.263+0000 9b10800 -1 osd.1 0 log_to_monitors {default=true} 2019-11-27T12:54:55.381 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:05.785 10046== Warning: unimplemented fcntl command: 1036 2019-11-27T12:54:55.393 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T12:54:55.371+0000 9b10800 -1 osd.2 0 log_to_monitors {default=true} 2019-11-27T12:54:55.451 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T12:54:55.448+0000 9b10800 -1 osd.4 0 log_to_monitors {default=true} 2019-11-27T12:54:55.586 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:54:55.566+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:55.595 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:54:55.581+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.630 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:54:55.584+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.668 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T12:54:55.613+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:55.677 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T12:54:55.649+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:55.679 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T12:54:55.629+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.691 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T12:54:55.674+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.700 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T12:54:55.632+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.710 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T12:54:55.678+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.809 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T12:54:55.756+0000 9b10800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-27T12:54:55.854 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T12:54:55.780+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:55.854 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T12:54:55.785+0000 9b10800 -1 journal do_read_entry(8192): bad header magic 2019-11-27T12:54:56.151 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:54:56.150+0000 9b10800 -1 osd.5 0 log_to_monitors {default=true} 2019-11-27T12:54:56.231 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T12:54:56.230+0000 9b10800 -1 osd.7 0 log_to_monitors {default=true} 2019-11-27T12:54:56.237 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T12:54:56.215+0000 9b10800 -1 osd.0 0 log_to_monitors {default=true} 2019-11-27T12:54:56.429 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T12:54:56.406+0000 9b10800 -1 osd.3 0 log_to_monitors {default=true} 2019-11-27T12:54:56.805 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T12:54:56.802+0000 2965c700 -1 osd.6 0 waiting for initial osdmap 2019-11-27T12:54:57.967 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T12:54:57.948+0000 29a5c700 -1 osd.4 0 waiting for initial osdmap 2019-11-27T12:54:57.971 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T12:54:57.967+0000 29a5c700 -1 osd.7 0 waiting for initial osdmap 2019-11-27T12:54:57.978 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-27T12:54:58.002 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T12:54:57.977+0000 29a5c700 -1 osd.2 0 waiting for initial osdmap 2019-11-27T12:54:58.009 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:54:57.999+0000 29a5c700 -1 osd.5 0 waiting for initial osdmap 2019-11-27T12:54:58.027 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T12:54:58.002+0000 29a5c700 -1 osd.1 0 waiting for initial osdmap 2019-11-27T12:54:58.767 INFO:teuthology.misc.health.smithi005.stdout: 2019-11-27T12:54:58.768 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":14,"fsid":"221e92ee-02f5-4189-a8d9-8c2cce99ef81","created":"2019-11-27T12:54:34.236835+0000","modified":"2019-11-27T12:54:58.541313+0000","last_up_change":"2019-11-27T12:54:58.541313+0000","last_in_change":"2019-11-27T12:54:58.541313+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"3d919c64-aa4e-4484-a16a-daa2fc22c750","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ca7dbbc-1f03-4470-8ef2-39e405978813","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53957d07-b094-418a-8b35-207001a956cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":10044},{"type":"v1","addr":"172.21.15.5:6803","nonce":10044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":10044},{"type":"v1","addr":"172.21.15.5:6805","nonce":10044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":10044},{"type":"v1","addr":"172.21.15.5:6814","nonce":10044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":10044},{"type":"v1","addr":"172.21.15.5:6809","nonce":10044}]},"public_addr":"172.21.15.5:6803/10044","cluster_addr":"172.21.15.5:6805/10044","heartbeat_back_addr":"172.21.15.5:6814/10044","heartbeat_front_addr":"172.21.15.5:6809/10044","state":["exists","up"]},{"osd":3,"uuid":"eca5baf0-831c-4706-99b5-e0d0cca20ab8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27394721-952d-4796-8c83-1b87a2336d0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":9157},{"type":"v1","addr":"172.21.15.115:6809","nonce":9157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":9157},{"type":"v1","addr":"172.21.15.115:6811","nonce":9157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":9157},{"type":"v1","addr":"172.21.15.115:6815","nonce":9157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":9157},{"type":"v1","addr":"172.21.15.115:6813","nonce":9157}]},"public_addr":"172.21.15.115:6809/9157","cluster_addr":"172.21.15.115:6811/9157","heartbeat_back_addr":"172.21.15.115:6815/9157","heartbeat_front_addr":"172.21.15.115:6813/9157","state":["exists","up"]},{"osd":5,"uuid":"04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":9158},{"type":"v1","addr":"172.21.15.115:6825","nonce":9158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":9158},{"type":"v1","addr":"172.21.15.115:6827","nonce":9158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":9158},{"type":"v1","addr":"172.21.15.115:6831","nonce":9158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":9158},{"type":"v1","addr":"172.21.15.115:6829","nonce":9158}]},"public_addr":"172.21.15.115:6825/9158","cluster_addr":"172.21.15.115:6827/9158","heartbeat_back_addr":"172.21.15.115:6831/9158","heartbeat_front_addr":"172.21.15.115:6829/9158","state":["exists","up"]},{"osd":6,"uuid":"dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":9159},{"type":"v1","addr":"172.21.15.115:6801","nonce":9159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":9159},{"type":"v1","addr":"172.21.15.115:6803","nonce":9159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":9159},{"type":"v1","addr":"172.21.15.115:6807","nonce":9159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":9159},{"type":"v1","addr":"172.21.15.115:6805","nonce":9159}]},"public_addr":"172.21.15.115:6801/9159","cluster_addr":"172.21.15.115:6803/9159","heartbeat_back_addr":"172.21.15.115:6807/9159","heartbeat_front_addr":"172.21.15.115:6805/9159","state":["exists","up"]},{"osd":7,"uuid":"6808852a-284d-48fd-a385-2757bc941376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":9156},{"type":"v1","addr":"172.21.15.115:6817","nonce":9156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":9156},{"type":"v1","addr":"172.21.15.115:6819","nonce":9156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":9156},{"type":"v1","addr":"172.21.15.115:6823","nonce":9156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":9156},{"type":"v1","addr":"172.21.15.115:6821","nonce":9156}]},"public_addr":"172.21.15.115:6817/9156","cluster_addr":"172.21.15.115:6819/9156","heartbeat_back_addr":"172.21.15.115:6823/9156","heartbeat_front_addr":"172.21.15.115:6821/9156","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.298020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T12:54:58.779 DEBUG:teuthology.misc:5 of 8 OSDs are up 2019-11-27T12:54:58.965 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T12:54:58.941+0000 29a5c700 -1 osd.0 0 waiting for initial osdmap 2019-11-27T12:54:58.983 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T12:54:58.959+0000 29a5c700 -1 osd.3 0 waiting for initial osdmap 2019-11-27T12:55:05.587 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-27T12:55:06.588 INFO:teuthology.misc.health.smithi005.stdout: 2019-11-27T12:55:06.589 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":16,"fsid":"221e92ee-02f5-4189-a8d9-8c2cce99ef81","created":"2019-11-27T12:54:34.236835+0000","modified":"2019-11-27T12:55:00.891228+0000","last_up_change":"2019-11-27T12:54:59.578802+0000","last_in_change":"2019-11-27T12:54:59.578802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"3d919c64-aa4e-4484-a16a-daa2fc22c750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":10045},{"type":"v1","addr":"172.21.15.5:6819","nonce":10045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":10045},{"type":"v1","addr":"172.21.15.5:6821","nonce":10045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":10045},{"type":"v1","addr":"172.21.15.5:6825","nonce":10045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":10045},{"type":"v1","addr":"172.21.15.5:6823","nonce":10045}]},"public_addr":"172.21.15.5:6819/10045","cluster_addr":"172.21.15.5:6821/10045","heartbeat_back_addr":"172.21.15.5:6825/10045","heartbeat_front_addr":"172.21.15.5:6823/10045","state":["exists","up"]},{"osd":1,"uuid":"4ca7dbbc-1f03-4470-8ef2-39e405978813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":10036},{"type":"v1","addr":"172.21.15.5:6807","nonce":10036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":10036},{"type":"v1","addr":"172.21.15.5:6811","nonce":10036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":10036},{"type":"v1","addr":"172.21.15.5:6817","nonce":10036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":10036},{"type":"v1","addr":"172.21.15.5:6815","nonce":10036}]},"public_addr":"172.21.15.5:6807/10036","cluster_addr":"172.21.15.5:6811/10036","heartbeat_back_addr":"172.21.15.5:6817/10036","heartbeat_front_addr":"172.21.15.5:6815/10036","state":["exists","up"]},{"osd":2,"uuid":"53957d07-b094-418a-8b35-207001a956cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":10044},{"type":"v1","addr":"172.21.15.5:6803","nonce":10044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":10044},{"type":"v1","addr":"172.21.15.5:6805","nonce":10044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":10044},{"type":"v1","addr":"172.21.15.5:6814","nonce":10044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":10044},{"type":"v1","addr":"172.21.15.5:6809","nonce":10044}]},"public_addr":"172.21.15.5:6803/10044","cluster_addr":"172.21.15.5:6805/10044","heartbeat_back_addr":"172.21.15.5:6814/10044","heartbeat_front_addr":"172.21.15.5:6809/10044","state":["exists","up"]},{"osd":3,"uuid":"eca5baf0-831c-4706-99b5-e0d0cca20ab8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":10046},{"type":"v1","addr":"172.21.15.5:6827","nonce":10046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":10046},{"type":"v1","addr":"172.21.15.5:6829","nonce":10046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":10046},{"type":"v1","addr":"172.21.15.5:6833","nonce":10046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":10046},{"type":"v1","addr":"172.21.15.5:6831","nonce":10046}]},"public_addr":"172.21.15.5:6827/10046","cluster_addr":"172.21.15.5:6829/10046","heartbeat_back_addr":"172.21.15.5:6833/10046","heartbeat_front_addr":"172.21.15.5:6831/10046","state":["exists","up"]},{"osd":4,"uuid":"27394721-952d-4796-8c83-1b87a2336d0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":9157},{"type":"v1","addr":"172.21.15.115:6809","nonce":9157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":9157},{"type":"v1","addr":"172.21.15.115:6811","nonce":9157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":9157},{"type":"v1","addr":"172.21.15.115:6815","nonce":9157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":9157},{"type":"v1","addr":"172.21.15.115:6813","nonce":9157}]},"public_addr":"172.21.15.115:6809/9157","cluster_addr":"172.21.15.115:6811/9157","heartbeat_back_addr":"172.21.15.115:6815/9157","heartbeat_front_addr":"172.21.15.115:6813/9157","state":["exists","up"]},{"osd":5,"uuid":"04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":9158},{"type":"v1","addr":"172.21.15.115:6825","nonce":9158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":9158},{"type":"v1","addr":"172.21.15.115:6827","nonce":9158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":9158},{"type":"v1","addr":"172.21.15.115:6831","nonce":9158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":9158},{"type":"v1","addr":"172.21.15.115:6829","nonce":9158}]},"public_addr":"172.21.15.115:6825/9158","cluster_addr":"172.21.15.115:6827/9158","heartbeat_back_addr":"172.21.15.115:6831/9158","heartbeat_front_addr":"172.21.15.115:6829/9158","state":["exists","up"]},{"osd":6,"uuid":"dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":9159},{"type":"v1","addr":"172.21.15.115:6801","nonce":9159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":9159},{"type":"v1","addr":"172.21.15.115:6803","nonce":9159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":9159},{"type":"v1","addr":"172.21.15.115:6807","nonce":9159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":9159},{"type":"v1","addr":"172.21.15.115:6805","nonce":9159}]},"public_addr":"172.21.15.115:6801/9159","cluster_addr":"172.21.15.115:6803/9159","heartbeat_back_addr":"172.21.15.115:6807/9159","heartbeat_front_addr":"172.21.15.115:6805/9159","state":["exists","up"]},{"osd":7,"uuid":"6808852a-284d-48fd-a385-2757bc941376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":9156},{"type":"v1","addr":"172.21.15.115:6817","nonce":9156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":9156},{"type":"v1","addr":"172.21.15.115:6819","nonce":9156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":9156},{"type":"v1","addr":"172.21.15.115:6823","nonce":9156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":9156},{"type":"v1","addr":"172.21.15.115:6821","nonce":9156}]},"public_addr":"172.21.15.115:6817/9156","cluster_addr":"172.21.15.115:6819/9156","heartbeat_back_addr":"172.21.15.115:6823/9156","heartbeat_front_addr":"172.21.15.115:6821/9156","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.354117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.365044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.471726+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.536074+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.599659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.267919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.298020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.299086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T12:55:06.608 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-27T12:55:06.608 INFO:tasks.ceph:Creating RBD pool 2019-11-27T12:55:06.608 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-27T12:55:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2019-11-27T12:55:09.020 INFO:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-27T12:55:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-27T12:55:11.091 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-27T12:55:11.091 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-27T12:55:11.092 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-27T12:55:11.883 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:11.883 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"221e92ee-02f5-4189-a8d9-8c2cce99ef81","created":"2019-11-27T12:54:34.236835+0000","modified":"2019-11-27T12:55:10.826946+0000","last_up_change":"2019-11-27T12:54:59.578802+0000","last_in_change":"2019-11-27T12:54:59.578802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-27T12:55:07.573467+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d919c64-aa4e-4484-a16a-daa2fc22c750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":10045},{"type":"v1","addr":"172.21.15.5:6819","nonce":10045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":10045},{"type":"v1","addr":"172.21.15.5:6821","nonce":10045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":10045},{"type":"v1","addr":"172.21.15.5:6825","nonce":10045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":10045},{"type":"v1","addr":"172.21.15.5:6823","nonce":10045}]},"public_addr":"172.21.15.5:6819/10045","cluster_addr":"172.21.15.5:6821/10045","heartbeat_back_addr":"172.21.15.5:6825/10045","heartbeat_front_addr":"172.21.15.5:6823/10045","state":["exists","up"]},{"osd":1,"uuid":"4ca7dbbc-1f03-4470-8ef2-39e405978813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":10036},{"type":"v1","addr":"172.21.15.5:6807","nonce":10036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":10036},{"type":"v1","addr":"172.21.15.5:6811","nonce":10036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":10036},{"type":"v1","addr":"172.21.15.5:6817","nonce":10036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":10036},{"type":"v1","addr":"172.21.15.5:6815","nonce":10036}]},"public_addr":"172.21.15.5:6807/10036","cluster_addr":"172.21.15.5:6811/10036","heartbeat_back_addr":"172.21.15.5:6817/10036","heartbeat_front_addr":"172.21.15.5:6815/10036","state":["exists","up"]},{"osd":2,"uuid":"53957d07-b094-418a-8b35-207001a956cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":10044},{"type":"v1","addr":"172.21.15.5:6803","nonce":10044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":10044},{"type":"v1","addr":"172.21.15.5:6805","nonce":10044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":10044},{"type":"v1","addr":"172.21.15.5:6814","nonce":10044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":10044},{"type":"v1","addr":"172.21.15.5:6809","nonce":10044}]},"public_addr":"172.21.15.5:6803/10044","cluster_addr":"172.21.15.5:6805/10044","heartbeat_back_addr":"172.21.15.5:6814/10044","heartbeat_front_addr":"172.21.15.5:6809/10044","state":["exists","up"]},{"osd":3,"uuid":"eca5baf0-831c-4706-99b5-e0d0cca20ab8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":10046},{"type":"v1","addr":"172.21.15.5:6827","nonce":10046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":10046},{"type":"v1","addr":"172.21.15.5:6829","nonce":10046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":10046},{"type":"v1","addr":"172.21.15.5:6833","nonce":10046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":10046},{"type":"v1","addr":"172.21.15.5:6831","nonce":10046}]},"public_addr":"172.21.15.5:6827/10046","cluster_addr":"172.21.15.5:6829/10046","heartbeat_back_addr":"172.21.15.5:6833/10046","heartbeat_front_addr":"172.21.15.5:6831/10046","state":["exists","up"]},{"osd":4,"uuid":"27394721-952d-4796-8c83-1b87a2336d0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":9157},{"type":"v1","addr":"172.21.15.115:6809","nonce":9157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":9157},{"type":"v1","addr":"172.21.15.115:6811","nonce":9157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":9157},{"type":"v1","addr":"172.21.15.115:6815","nonce":9157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":9157},{"type":"v1","addr":"172.21.15.115:6813","nonce":9157}]},"public_addr":"172.21.15.115:6809/9157","cluster_addr":"172.21.15.115:6811/9157","heartbeat_back_addr":"172.21.15.115:6815/9157","heartbeat_front_addr":"172.21.15.115:6813/9157","state":["exists","up"]},{"osd":5,"uuid":"04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":9158},{"type":"v1","addr":"172.21.15.115:6825","nonce":9158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":9158},{"type":"v1","addr":"172.21.15.115:6827","nonce":9158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":9158},{"type":"v1","addr":"172.21.15.115:6831","nonce":9158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":9158},{"type":"v1","addr":"172.21.15.115:6829","nonce":9158}]},"public_addr":"172.21.15.115:6825/9158","cluster_addr":"172.21.15.115:6827/9158","heartbeat_back_addr":"172.21.15.115:6831/9158","heartbeat_front_addr":"172.21.15.115:6829/9158","state":["exists","up"]},{"osd":6,"uuid":"dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":9159},{"type":"v1","addr":"172.21.15.115:6801","nonce":9159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":9159},{"type":"v1","addr":"172.21.15.115:6803","nonce":9159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":9159},{"type":"v1","addr":"172.21.15.115:6807","nonce":9159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":9159},{"type":"v1","addr":"172.21.15.115:6805","nonce":9159}]},"public_addr":"172.21.15.115:6801/9159","cluster_addr":"172.21.15.115:6803/9159","heartbeat_back_addr":"172.21.15.115:6807/9159","heartbeat_front_addr":"172.21.15.115:6805/9159","state":["exists","up"]},{"osd":7,"uuid":"6808852a-284d-48fd-a385-2757bc941376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":9156},{"type":"v1","addr":"172.21.15.115:6817","nonce":9156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":9156},{"type":"v1","addr":"172.21.15.115:6819","nonce":9156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":9156},{"type":"v1","addr":"172.21.15.115:6823","nonce":9156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":9156},{"type":"v1","addr":"172.21.15.115:6821","nonce":9156}]},"public_addr":"172.21.15.115:6817/9156","cluster_addr":"172.21.15.115:6819/9156","heartbeat_back_addr":"172.21.15.115:6823/9156","heartbeat_front_addr":"172.21.15.115:6821/9156","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.354117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.365044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.471726+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.536074+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.599659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.267919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.298020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.299086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T12:55:11.896 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-27T12:55:07.573467+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-27T12:55:11.896 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-27T12:55:12.661 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2019-11-27T12:55:12.687 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-27T12:55:12.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-27T12:55:12.687 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-27T12:55:13.768 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:13.784 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":8649},{"type":"v1","addr":"172.21.15.5:6801","nonce":8649}]},"active_addr":"172.21.15.5:6801/8649","active_change":"2019-11-27T12:54:38.509396+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-27T12:55:13.788 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-27T12:55:13.788 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-27T12:55:13.788 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-27T12:55:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:14.636 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"221e92ee-02f5-4189-a8d9-8c2cce99ef81","created":"2019-11-27T12:54:34.236835+0000","modified":"2019-11-27T12:55:12.280139+0000","last_up_change":"2019-11-27T12:54:59.578802+0000","last_in_change":"2019-11-27T12:54:59.578802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-27T12:55:07.573467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d919c64-aa4e-4484-a16a-daa2fc22c750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":10045},{"type":"v1","addr":"172.21.15.5:6819","nonce":10045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":10045},{"type":"v1","addr":"172.21.15.5:6821","nonce":10045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":10045},{"type":"v1","addr":"172.21.15.5:6825","nonce":10045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":10045},{"type":"v1","addr":"172.21.15.5:6823","nonce":10045}]},"public_addr":"172.21.15.5:6819/10045","cluster_addr":"172.21.15.5:6821/10045","heartbeat_back_addr":"172.21.15.5:6825/10045","heartbeat_front_addr":"172.21.15.5:6823/10045","state":["exists","up"]},{"osd":1,"uuid":"4ca7dbbc-1f03-4470-8ef2-39e405978813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":10036},{"type":"v1","addr":"172.21.15.5:6807","nonce":10036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":10036},{"type":"v1","addr":"172.21.15.5:6811","nonce":10036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":10036},{"type":"v1","addr":"172.21.15.5:6817","nonce":10036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":10036},{"type":"v1","addr":"172.21.15.5:6815","nonce":10036}]},"public_addr":"172.21.15.5:6807/10036","cluster_addr":"172.21.15.5:6811/10036","heartbeat_back_addr":"172.21.15.5:6817/10036","heartbeat_front_addr":"172.21.15.5:6815/10036","state":["exists","up"]},{"osd":2,"uuid":"53957d07-b094-418a-8b35-207001a956cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":10044},{"type":"v1","addr":"172.21.15.5:6803","nonce":10044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":10044},{"type":"v1","addr":"172.21.15.5:6805","nonce":10044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":10044},{"type":"v1","addr":"172.21.15.5:6814","nonce":10044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":10044},{"type":"v1","addr":"172.21.15.5:6809","nonce":10044}]},"public_addr":"172.21.15.5:6803/10044","cluster_addr":"172.21.15.5:6805/10044","heartbeat_back_addr":"172.21.15.5:6814/10044","heartbeat_front_addr":"172.21.15.5:6809/10044","state":["exists","up"]},{"osd":3,"uuid":"eca5baf0-831c-4706-99b5-e0d0cca20ab8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":10046},{"type":"v1","addr":"172.21.15.5:6827","nonce":10046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":10046},{"type":"v1","addr":"172.21.15.5:6829","nonce":10046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":10046},{"type":"v1","addr":"172.21.15.5:6833","nonce":10046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":10046},{"type":"v1","addr":"172.21.15.5:6831","nonce":10046}]},"public_addr":"172.21.15.5:6827/10046","cluster_addr":"172.21.15.5:6829/10046","heartbeat_back_addr":"172.21.15.5:6833/10046","heartbeat_front_addr":"172.21.15.5:6831/10046","state":["exists","up"]},{"osd":4,"uuid":"27394721-952d-4796-8c83-1b87a2336d0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":9157},{"type":"v1","addr":"172.21.15.115:6809","nonce":9157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":9157},{"type":"v1","addr":"172.21.15.115:6811","nonce":9157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":9157},{"type":"v1","addr":"172.21.15.115:6815","nonce":9157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":9157},{"type":"v1","addr":"172.21.15.115:6813","nonce":9157}]},"public_addr":"172.21.15.115:6809/9157","cluster_addr":"172.21.15.115:6811/9157","heartbeat_back_addr":"172.21.15.115:6815/9157","heartbeat_front_addr":"172.21.15.115:6813/9157","state":["exists","up"]},{"osd":5,"uuid":"04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":9158},{"type":"v1","addr":"172.21.15.115:6825","nonce":9158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":9158},{"type":"v1","addr":"172.21.15.115:6827","nonce":9158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":9158},{"type":"v1","addr":"172.21.15.115:6831","nonce":9158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":9158},{"type":"v1","addr":"172.21.15.115:6829","nonce":9158}]},"public_addr":"172.21.15.115:6825/9158","cluster_addr":"172.21.15.115:6827/9158","heartbeat_back_addr":"172.21.15.115:6831/9158","heartbeat_front_addr":"172.21.15.115:6829/9158","state":["exists","up"]},{"osd":6,"uuid":"dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":9159},{"type":"v1","addr":"172.21.15.115:6801","nonce":9159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":9159},{"type":"v1","addr":"172.21.15.115:6803","nonce":9159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":9159},{"type":"v1","addr":"172.21.15.115:6807","nonce":9159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":9159},{"type":"v1","addr":"172.21.15.115:6805","nonce":9159}]},"public_addr":"172.21.15.115:6801/9159","cluster_addr":"172.21.15.115:6803/9159","heartbeat_back_addr":"172.21.15.115:6807/9159","heartbeat_front_addr":"172.21.15.115:6805/9159","state":["exists","up"]},{"osd":7,"uuid":"6808852a-284d-48fd-a385-2757bc941376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":9156},{"type":"v1","addr":"172.21.15.115:6817","nonce":9156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":9156},{"type":"v1","addr":"172.21.15.115:6819","nonce":9156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":9156},{"type":"v1","addr":"172.21.15.115:6823","nonce":9156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":9156},{"type":"v1","addr":"172.21.15.115:6821","nonce":9156}]},"public_addr":"172.21.15.115:6817/9156","cluster_addr":"172.21.15.115:6819/9156","heartbeat_back_addr":"172.21.15.115:6823/9156","heartbeat_front_addr":"172.21.15.115:6821/9156","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.354117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.365044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.471726+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.536074+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.599659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.267919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.298020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.299086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T12:55:14.653 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-27T12:55:14.653 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-27T12:55:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:15.458 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"221e92ee-02f5-4189-a8d9-8c2cce99ef81","created":"2019-11-27T12:54:34.236835+0000","modified":"2019-11-27T12:55:12.280139+0000","last_up_change":"2019-11-27T12:54:59.578802+0000","last_in_change":"2019-11-27T12:54:59.578802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-27T12:55:07.573467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d919c64-aa4e-4484-a16a-daa2fc22c750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":10045},{"type":"v1","addr":"172.21.15.5:6819","nonce":10045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":10045},{"type":"v1","addr":"172.21.15.5:6821","nonce":10045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":10045},{"type":"v1","addr":"172.21.15.5:6825","nonce":10045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":10045},{"type":"v1","addr":"172.21.15.5:6823","nonce":10045}]},"public_addr":"172.21.15.5:6819/10045","cluster_addr":"172.21.15.5:6821/10045","heartbeat_back_addr":"172.21.15.5:6825/10045","heartbeat_front_addr":"172.21.15.5:6823/10045","state":["exists","up"]},{"osd":1,"uuid":"4ca7dbbc-1f03-4470-8ef2-39e405978813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":10036},{"type":"v1","addr":"172.21.15.5:6807","nonce":10036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":10036},{"type":"v1","addr":"172.21.15.5:6811","nonce":10036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":10036},{"type":"v1","addr":"172.21.15.5:6817","nonce":10036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":10036},{"type":"v1","addr":"172.21.15.5:6815","nonce":10036}]},"public_addr":"172.21.15.5:6807/10036","cluster_addr":"172.21.15.5:6811/10036","heartbeat_back_addr":"172.21.15.5:6817/10036","heartbeat_front_addr":"172.21.15.5:6815/10036","state":["exists","up"]},{"osd":2,"uuid":"53957d07-b094-418a-8b35-207001a956cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":10044},{"type":"v1","addr":"172.21.15.5:6803","nonce":10044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":10044},{"type":"v1","addr":"172.21.15.5:6805","nonce":10044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":10044},{"type":"v1","addr":"172.21.15.5:6814","nonce":10044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":10044},{"type":"v1","addr":"172.21.15.5:6809","nonce":10044}]},"public_addr":"172.21.15.5:6803/10044","cluster_addr":"172.21.15.5:6805/10044","heartbeat_back_addr":"172.21.15.5:6814/10044","heartbeat_front_addr":"172.21.15.5:6809/10044","state":["exists","up"]},{"osd":3,"uuid":"eca5baf0-831c-4706-99b5-e0d0cca20ab8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":10046},{"type":"v1","addr":"172.21.15.5:6827","nonce":10046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":10046},{"type":"v1","addr":"172.21.15.5:6829","nonce":10046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":10046},{"type":"v1","addr":"172.21.15.5:6833","nonce":10046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":10046},{"type":"v1","addr":"172.21.15.5:6831","nonce":10046}]},"public_addr":"172.21.15.5:6827/10046","cluster_addr":"172.21.15.5:6829/10046","heartbeat_back_addr":"172.21.15.5:6833/10046","heartbeat_front_addr":"172.21.15.5:6831/10046","state":["exists","up"]},{"osd":4,"uuid":"27394721-952d-4796-8c83-1b87a2336d0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":9157},{"type":"v1","addr":"172.21.15.115:6809","nonce":9157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":9157},{"type":"v1","addr":"172.21.15.115:6811","nonce":9157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":9157},{"type":"v1","addr":"172.21.15.115:6815","nonce":9157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":9157},{"type":"v1","addr":"172.21.15.115:6813","nonce":9157}]},"public_addr":"172.21.15.115:6809/9157","cluster_addr":"172.21.15.115:6811/9157","heartbeat_back_addr":"172.21.15.115:6815/9157","heartbeat_front_addr":"172.21.15.115:6813/9157","state":["exists","up"]},{"osd":5,"uuid":"04e32ae4-ebd4-49a5-8f5a-4e6d2e021edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":9158},{"type":"v1","addr":"172.21.15.115:6825","nonce":9158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":9158},{"type":"v1","addr":"172.21.15.115:6827","nonce":9158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":9158},{"type":"v1","addr":"172.21.15.115:6831","nonce":9158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":9158},{"type":"v1","addr":"172.21.15.115:6829","nonce":9158}]},"public_addr":"172.21.15.115:6825/9158","cluster_addr":"172.21.15.115:6827/9158","heartbeat_back_addr":"172.21.15.115:6831/9158","heartbeat_front_addr":"172.21.15.115:6829/9158","state":["exists","up"]},{"osd":6,"uuid":"dfd13eda-91f5-4ffe-9e58-fa6ac07f37bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":9159},{"type":"v1","addr":"172.21.15.115:6801","nonce":9159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":9159},{"type":"v1","addr":"172.21.15.115:6803","nonce":9159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":9159},{"type":"v1","addr":"172.21.15.115:6807","nonce":9159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":9159},{"type":"v1","addr":"172.21.15.115:6805","nonce":9159}]},"public_addr":"172.21.15.115:6801/9159","cluster_addr":"172.21.15.115:6803/9159","heartbeat_back_addr":"172.21.15.115:6807/9159","heartbeat_front_addr":"172.21.15.115:6805/9159","state":["exists","up"]},{"osd":7,"uuid":"6808852a-284d-48fd-a385-2757bc941376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":9156},{"type":"v1","addr":"172.21.15.115:6817","nonce":9156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":9156},{"type":"v1","addr":"172.21.15.115:6819","nonce":9156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":9156},{"type":"v1","addr":"172.21.15.115:6823","nonce":9156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":9156},{"type":"v1","addr":"172.21.15.115:6821","nonce":9156}]},"public_addr":"172.21.15.115:6817/9156","cluster_addr":"172.21.15.115:6819/9156","heartbeat_back_addr":"172.21.15.115:6823/9156","heartbeat_front_addr":"172.21.15.115:6821/9156","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.354117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.365044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.471726+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.536074+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.599659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.267919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:56.298020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T12:54:57.299086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T12:55:15.479 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-27T12:55:16.096 INFO:teuthology.orchestra.run.smithi005.stdout:64424509446 2019-11-27T12:55:16.097 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-27T12:55:16.680 INFO:teuthology.orchestra.run.smithi005.stdout:64424509447 2019-11-27T12:55:16.681 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-27T12:55:17.182 INFO:teuthology.orchestra.run.smithi005.stdout:60129542150 2019-11-27T12:55:17.182 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-27T12:55:17.721 INFO:teuthology.orchestra.run.smithi005.stdout:64424509446 2019-11-27T12:55:17.722 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-27T12:55:18.283 INFO:teuthology.orchestra.run.smithi005.stdout:60129542150 2019-11-27T12:55:18.283 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-27T12:55:18.891 INFO:teuthology.orchestra.run.smithi005.stdout:60129542150 2019-11-27T12:55:18.892 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-27T12:55:19.480 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2019-11-27T12:55:19.480 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-27T12:55:20.101 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2019-11-27T12:55:20.102 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-27T12:55:20.980 INFO:teuthology.orchestra.run.smithi005.stdout:64424509447 2019-11-27T12:55:20.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.0 2019-11-27T12:55:20.994 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-27T12:55:21.803 INFO:teuthology.orchestra.run.smithi005.stdout:64424509448 2019-11-27T12:55:21.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.1 2019-11-27T12:55:21.817 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-27T12:55:22.528 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2019-11-27T12:55:22.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.2 2019-11-27T12:55:22.542 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-27T12:55:23.321 INFO:teuthology.orchestra.run.smithi005.stdout:64424509447 2019-11-27T12:55:23.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2019-11-27T12:55:23.341 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-27T12:55:24.158 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2019-11-27T12:55:24.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.4 2019-11-27T12:55:24.172 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-27T12:55:25.004 INFO:teuthology.orchestra.run.smithi005.stdout:60129542151 2019-11-27T12:55:25.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.5 2019-11-27T12:55:25.025 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-27T12:55:25.930 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2019-11-27T12:55:25.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2019-11-27T12:55:25.944 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-27T12:55:26.847 INFO:teuthology.orchestra.run.smithi005.stdout:60129542152 2019-11-27T12:55:26.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.7 2019-11-27T12:55:26.869 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-27T12:55:26.869 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-27T12:55:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2019-11-27T12:55:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:27.667 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-11-27T12:55:26.741490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699648,"kb_used_data":747895392,"kb_used_omap":302,"kb_used_meta":0,"kb_avail":747895392,"statfs":{"total":767585320960,"available":765844881408,"internally_reserved":0,"allocated":765844881408,"data_stored":765844881408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":309730,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.744150+0000","last_change":"2019-11-27T12:55:11.732275+0000","last_active":"2019-11-27T12:55:11.744150+0000","last_peered":"2019-11-27T12:55:11.744150+0000","last_clean":"2019-11-27T12:55:11.744150+0000","last_became_active":"2019-11-27T12:55:11.715885+0000","last_became_peered":"2019-11-27T12:55:11.715885+0000","last_unstale":"2019-11-27T12:55:11.744150+0000","last_undegraded":"2019-11-27T12:55:11.744150+0000","last_fullsized":"2019-11-27T12:55:11.744150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.881847+0000","last_change":"2019-11-27T12:55:11.861846+0000","last_active":"2019-11-27T12:55:11.881847+0000","last_peered":"2019-11-27T12:55:11.881847+0000","last_clean":"2019-11-27T12:55:11.881847+0000","last_became_active":"2019-11-27T12:55:11.842297+0000","last_became_peered":"2019-11-27T12:55:11.842297+0000","last_unstale":"2019-11-27T12:55:11.881847+0000","last_undegraded":"2019-11-27T12:55:11.881847+0000","last_fullsized":"2019-11-27T12:55:11.881847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.813088+0000","last_change":"2019-11-27T12:55:11.789017+0000","last_active":"2019-11-27T12:55:11.813088+0000","last_peered":"2019-11-27T12:55:11.813088+0000","last_clean":"2019-11-27T12:55:11.813088+0000","last_became_active":"2019-11-27T12:55:11.754359+0000","last_became_peered":"2019-11-27T12:55:11.754359+0000","last_unstale":"2019-11-27T12:55:11.813088+0000","last_undegraded":"2019-11-27T12:55:11.813088+0000","last_fullsized":"2019-11-27T12:55:11.813088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.328200+0000","last_change":"2019-11-27T12:55:10.428392+0000","last_active":"2019-11-27T12:55:11.328200+0000","last_peered":"2019-11-27T12:55:11.328200+0000","last_clean":"2019-11-27T12:55:11.328200+0000","last_became_active":"2019-11-27T12:55:10.395654+0000","last_became_peered":"2019-11-27T12:55:10.395654+0000","last_unstale":"2019-11-27T12:55:11.328200+0000","last_undegraded":"2019-11-27T12:55:11.328200+0000","last_fullsized":"2019-11-27T12:55:11.328200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.690267+0000","last_change":"2019-11-27T12:55:11.653665+0000","last_active":"2019-11-27T12:55:11.690267+0000","last_peered":"2019-11-27T12:55:11.690267+0000","last_clean":"2019-11-27T12:55:11.690267+0000","last_became_active":"2019-11-27T12:55:11.630244+0000","last_became_peered":"2019-11-27T12:55:11.630244+0000","last_unstale":"2019-11-27T12:55:11.690267+0000","last_undegraded":"2019-11-27T12:55:11.690267+0000","last_fullsized":"2019-11-27T12:55:11.690267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.871910+0000","last_change":"2019-11-27T12:55:11.835515+0000","last_active":"2019-11-27T12:55:11.871910+0000","last_peered":"2019-11-27T12:55:11.871910+0000","last_clean":"2019-11-27T12:55:11.871910+0000","last_became_active":"2019-11-27T12:55:11.766171+0000","last_became_peered":"2019-11-27T12:55:11.766171+0000","last_unstale":"2019-11-27T12:55:11.871910+0000","last_undegraded":"2019-11-27T12:55:11.871910+0000","last_fullsized":"2019-11-27T12:55:11.871910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.336185+0000","last_change":"2019-11-27T12:55:11.319908+0000","last_active":"2019-11-27T12:55:11.336185+0000","last_peered":"2019-11-27T12:55:11.336185+0000","last_clean":"2019-11-27T12:55:11.336185+0000","last_became_active":"2019-11-27T12:55:11.289445+0000","last_became_peered":"2019-11-27T12:55:11.289445+0000","last_unstale":"2019-11-27T12:55:11.336185+0000","last_undegraded":"2019-11-27T12:55:11.336185+0000","last_fullsized":"2019-11-27T12:55:11.336185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.427839+0000","last_change":"2019-11-27T12:55:11.410983+0000","last_active":"2019-11-27T12:55:11.427839+0000","last_peered":"2019-11-27T12:55:11.427839+0000","last_clean":"2019-11-27T12:55:11.427839+0000","last_became_active":"2019-11-27T12:55:11.381685+0000","last_became_peered":"2019-11-27T12:55:11.381685+0000","last_unstale":"2019-11-27T12:55:11.427839+0000","last_undegraded":"2019-11-27T12:55:11.427839+0000","last_fullsized":"2019-11-27T12:55:11.427839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38735,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.322}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.831}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.199}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.790}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.575}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.082}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.134}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43587,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.355}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.853}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.831}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.413}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.977}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.059}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.461}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38703,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.427}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.920}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.649}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.642}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.941}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.307}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.158}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33915,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.021}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.354}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.837}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.806}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.830}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.392}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.397}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":47,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48313,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.828}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.343}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.140}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.136}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.914}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.397}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33877,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.046}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.712}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.394}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.492}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.668}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.154}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38729,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.610}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.043}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.244}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.040}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.924}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.776}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.876}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33871,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.176}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.263}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.177}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.988}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.138}]}]}]}} 2019-11-27T12:55:27.670 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-27T12:55:28.503 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2019-11-27T12:55:28.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:28.516 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-11-27T12:55:26.741490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699648,"kb_used_data":747895392,"kb_used_omap":302,"kb_used_meta":0,"kb_avail":747895392,"statfs":{"total":767585320960,"available":765844881408,"internally_reserved":0,"allocated":765844881408,"data_stored":765844881408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":309730,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.744150+0000","last_change":"2019-11-27T12:55:11.732275+0000","last_active":"2019-11-27T12:55:11.744150+0000","last_peered":"2019-11-27T12:55:11.744150+0000","last_clean":"2019-11-27T12:55:11.744150+0000","last_became_active":"2019-11-27T12:55:11.715885+0000","last_became_peered":"2019-11-27T12:55:11.715885+0000","last_unstale":"2019-11-27T12:55:11.744150+0000","last_undegraded":"2019-11-27T12:55:11.744150+0000","last_fullsized":"2019-11-27T12:55:11.744150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.881847+0000","last_change":"2019-11-27T12:55:11.861846+0000","last_active":"2019-11-27T12:55:11.881847+0000","last_peered":"2019-11-27T12:55:11.881847+0000","last_clean":"2019-11-27T12:55:11.881847+0000","last_became_active":"2019-11-27T12:55:11.842297+0000","last_became_peered":"2019-11-27T12:55:11.842297+0000","last_unstale":"2019-11-27T12:55:11.881847+0000","last_undegraded":"2019-11-27T12:55:11.881847+0000","last_fullsized":"2019-11-27T12:55:11.881847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.813088+0000","last_change":"2019-11-27T12:55:11.789017+0000","last_active":"2019-11-27T12:55:11.813088+0000","last_peered":"2019-11-27T12:55:11.813088+0000","last_clean":"2019-11-27T12:55:11.813088+0000","last_became_active":"2019-11-27T12:55:11.754359+0000","last_became_peered":"2019-11-27T12:55:11.754359+0000","last_unstale":"2019-11-27T12:55:11.813088+0000","last_undegraded":"2019-11-27T12:55:11.813088+0000","last_fullsized":"2019-11-27T12:55:11.813088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.328200+0000","last_change":"2019-11-27T12:55:10.428392+0000","last_active":"2019-11-27T12:55:11.328200+0000","last_peered":"2019-11-27T12:55:11.328200+0000","last_clean":"2019-11-27T12:55:11.328200+0000","last_became_active":"2019-11-27T12:55:10.395654+0000","last_became_peered":"2019-11-27T12:55:10.395654+0000","last_unstale":"2019-11-27T12:55:11.328200+0000","last_undegraded":"2019-11-27T12:55:11.328200+0000","last_fullsized":"2019-11-27T12:55:11.328200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.690267+0000","last_change":"2019-11-27T12:55:11.653665+0000","last_active":"2019-11-27T12:55:11.690267+0000","last_peered":"2019-11-27T12:55:11.690267+0000","last_clean":"2019-11-27T12:55:11.690267+0000","last_became_active":"2019-11-27T12:55:11.630244+0000","last_became_peered":"2019-11-27T12:55:11.630244+0000","last_unstale":"2019-11-27T12:55:11.690267+0000","last_undegraded":"2019-11-27T12:55:11.690267+0000","last_fullsized":"2019-11-27T12:55:11.690267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.871910+0000","last_change":"2019-11-27T12:55:11.835515+0000","last_active":"2019-11-27T12:55:11.871910+0000","last_peered":"2019-11-27T12:55:11.871910+0000","last_clean":"2019-11-27T12:55:11.871910+0000","last_became_active":"2019-11-27T12:55:11.766171+0000","last_became_peered":"2019-11-27T12:55:11.766171+0000","last_unstale":"2019-11-27T12:55:11.871910+0000","last_undegraded":"2019-11-27T12:55:11.871910+0000","last_fullsized":"2019-11-27T12:55:11.871910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.336185+0000","last_change":"2019-11-27T12:55:11.319908+0000","last_active":"2019-11-27T12:55:11.336185+0000","last_peered":"2019-11-27T12:55:11.336185+0000","last_clean":"2019-11-27T12:55:11.336185+0000","last_became_active":"2019-11-27T12:55:11.289445+0000","last_became_peered":"2019-11-27T12:55:11.289445+0000","last_unstale":"2019-11-27T12:55:11.336185+0000","last_undegraded":"2019-11-27T12:55:11.336185+0000","last_fullsized":"2019-11-27T12:55:11.336185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-27T12:55:11.427839+0000","last_change":"2019-11-27T12:55:11.410983+0000","last_active":"2019-11-27T12:55:11.427839+0000","last_peered":"2019-11-27T12:55:11.427839+0000","last_clean":"2019-11-27T12:55:11.427839+0000","last_became_active":"2019-11-27T12:55:11.381685+0000","last_became_peered":"2019-11-27T12:55:11.381685+0000","last_unstale":"2019-11-27T12:55:11.427839+0000","last_undegraded":"2019-11-27T12:55:11.427839+0000","last_fullsized":"2019-11-27T12:55:11.427839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T12:55:08.384777+0000","last_clean_scrub_stamp":"2019-11-27T12:55:08.384777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38735,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.322}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.831}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.199}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.790}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.575}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.082}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.134}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43587,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.355}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.853}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.831}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.413}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.977}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.059}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.461}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38703,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.427}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.920}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.649}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.642}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.941}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.307}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.158}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33915,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.021}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.354}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.837}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.806}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.830}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.392}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.397}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":47,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48313,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.828}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.343}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.140}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.136}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.914}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.397}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33877,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.046}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.712}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.394}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.492}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.668}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.154}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38729,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.610}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.043}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.244}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.040}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.924}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.776}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.876}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212456,"kb_used_data":93486924,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486924,"statfs":{"total":95948165120,"available":95730610176,"internally_reserved":0,"allocated":95730610176,"data_stored":95730610176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33871,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.176}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.263}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.177}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.988}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.138}]}]}]}} 2019-11-27T12:55:28.518 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-27T12:55:28.519 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-27T12:55:28.519 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-27T12:55:28.520 INFO:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-27T12:55:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T12:55:29.302 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-27T12:55:29.303 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-27T12:55:29.303 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-11-27T12:55:29.315 INFO:teuthology.run_tasks:Running task rgw... 2019-11-27T12:55:29.332 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-11-27T12:55:29.333 DEBUG:tasks.rgw:client list is ['client.0'] 2019-11-27T12:55:29.333 INFO:tasks.rgw:Creating data pools 2019-11-27T12:55:29.333 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-11-27T12:55:29.333 INFO:teuthology.orchestra.run.smithi005:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2019-11-27T12:55:31.621 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'default.rgw.buckets.data' created 2019-11-27T12:55:31.637 INFO:teuthology.orchestra.run.smithi005:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-11-27T12:55:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-11-27T12:55:32.864 INFO:teuthology.orchestra.run.smithi005:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-11-27T12:55:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'default.rgw.buckets.index' created 2019-11-27T12:55:35.120 INFO:teuthology.orchestra.run.smithi005:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-11-27T12:55:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-11-27T12:55:36.296 DEBUG:tasks.rgw:Pools created 2019-11-27T12:55:36.296 INFO:tasks.rgw:Configuring compression type = random 2019-11-27T12:55:36.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-27T12:55:36.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-27T12:55:36.296 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-27T12:55:36.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:36.515+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.403+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.403+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.447+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.447+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:39.495 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.475+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:39.495 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.475+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:39.569+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.394+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.407+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.407+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.488+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.488+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.494+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.494+0000 7ff452d6fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T12:55:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.494+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.501+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.501+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.507+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.507+0000 7ff452d6fec0 10 Creating default zonegroup 2019-11-27T12:55:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.507+0000 7ff452d6fec0 20 get_system_obj_state: rctx=0x7ffff3f96e80 obj=:.pools.avail state=0x559d606c9500 s->prefetch_data=0 2019-11-27T12:55:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.527+0000 7ff452d6fec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-11-27T12:55:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.865+0000 7ff452d6fec0 10 WARNING: store->list_zones() returned r=-2 2019-11-27T12:55:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.865+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:41.874+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:42.858+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:42.889 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:42.867+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:42.867+0000 7ff452d6fec0 10 could not read realm id: (2) No such file or directory 2019-11-27T12:55:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:42.868+0000 7ff452d6fec0 10 WARNING: failed to set zone as default, r=-22 2019-11-27T12:55:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:42.868+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:42.898 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:42.876+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.533+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.586+0000 7ff44079d700 0 -- 172.21.15.5:0/3280774851 >> [v2:172.21.15.115:6800/9159,v1:172.21.15.115:6801/9159] conn(0x559d606befe0 msgr2=0x559d606c1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T12:55:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.586+0000 7ff452d6fec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-27T12:55:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.586+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.648+0000 7ff452d6fec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T12:55:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.648+0000 7ff452d6fec0 20 zonegroup default 2019-11-27T12:55:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.648+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.662+0000 7ff452d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:55:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.662+0000 7ff452d6fec0 10 Cannot find current period zone using local zone 2019-11-27T12:55:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.662+0000 7ff452d6fec0 10 Using default name default 2019-11-27T12:55:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.662+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.717+0000 7ff452d6fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:55:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.717+0000 7ff452d6fec0 20 rados->read ofs=0 len=0 2019-11-27T12:55:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.735+0000 7ff452d6fec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-27T12:55:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.735+0000 7ff452d6fec0 20 zone default found 2019-11-27T12:55:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.735+0000 7ff452d6fec0 20 started sync module instance, tier type = 2019-11-27T12:55:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:43.735+0000 7ff452d6fec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T12:55:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:47.892+0000 7ff43ff9c700 0 -- 172.21.15.5:0/3280774851 >> [v2:172.21.15.115:6816/9156,v1:172.21.15.115:6817/9156] conn(0x559d606c23d0 msgr2=0x559d606c47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T12:55:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=0 2019-11-27T12:55:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=1 2019-11-27T12:55:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=2 2019-11-27T12:55:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=3 2019-11-27T12:55:48.518 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=4 2019-11-27T12:55:48.518 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=5 2019-11-27T12:55:48.518 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.495+0000 7ff452d6fec0 20 add_watcher() i=6 2019-11-27T12:55:48.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.533+0000 7ff452d6fec0 20 add_watcher() i=7 2019-11-27T12:55:48.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.533+0000 7ff452d6fec0 2 all 8 watchers are set, enabling cache 2019-11-27T12:55:48.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:48.534+0000 7ff38bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T12:55:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:52.564+0000 7ff452d6fec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-11-27T12:55:57.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:55:57.365+0000 7ff452d6fec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-11-27T12:56:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.198+0000 7ff37a7fc700 20 reqs_thread_entry: start 2019-11-27T12:56:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.199+0000 7ff36bfff700 20 reqs_thread_entry: start 2019-11-27T12:56:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.199+0000 7ff452d6fec0 20 init_complete bucket index max shards: 0 2019-11-27T12:56:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.200+0000 7ff36a7fc700 20 reqs_thread_entry: start 2019-11-27T12:56:01.550 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.527+0000 7ff452d6fec0 20 remove_watcher() i=0 2019-11-27T12:56:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.527+0000 7ff452d6fec0 2 removed watcher, disabling cache 2019-11-27T12:56:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.646+0000 7ff452d6fec0 20 remove_watcher() i=1 2019-11-27T12:56:01.719 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.697+0000 7ff452d6fec0 20 remove_watcher() i=2 2019-11-27T12:56:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.751+0000 7ff452d6fec0 20 remove_watcher() i=3 2019-11-27T12:56:01.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.818+0000 7ff452d6fec0 20 remove_watcher() i=4 2019-11-27T12:56:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.878+0000 7ff452d6fec0 20 remove_watcher() i=5 2019-11-27T12:56:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:01.962+0000 7ff452d6fec0 20 remove_watcher() i=6 2019-11-27T12:56:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.028+0000 7ff452d6fec0 20 remove_watcher() i=7 2019-11-27T12:56:02.064 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2019-11-27T12:56:02.065 DEBUG:tasks.util.rgw: json result: [] 2019-11-27T12:56:02.065 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-27T12:56:02.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-27T12:56:02.065 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-11-27T12:56:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.232+0000 7fcf0b7fe700 20 reqs_thread_entry: start 2019-11-27T12:56:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.233+0000 7fcfd6779ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.252+0000 7fcfd6779ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.252+0000 7fcfd6779ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.272+0000 7fcfd6779ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-27T12:56:02.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.272+0000 7fcfd6779ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.301 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.279+0000 7fcfd6779ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:02.301 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.279+0000 7fcfd6779ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.311 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.288+0000 7fcfd6779ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:02.311 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.288+0000 7fcfd6779ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.311+0000 7fcfd6779ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T12:56:02.430 INFO:teuthology.orchestra.run.smithi005.stdout:{"id":"dc4084cb-262b-4d5b-9664-fa175bfdb24a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-27T12:56:02.431 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'dc4084cb-262b-4d5b-9664-fa175bfdb24a', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-27T12:56:02.431 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-27T12:56:02.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-27T12:56:02.431 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-27T12:56:02.666 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.643+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.708 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.686+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:02.708 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.686+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.701+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.701+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.710+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.710+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:02.733+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.074+0000 7f35a76cfec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T12:56:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.074+0000 7f35a76cfec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T12:56:03.098 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.074+0000 7f35a76cfec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T12:56:03.098 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.074+0000 7f35a76cfec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T12:56:03.098 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.074+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.090+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.090+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.111+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T12:56:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.111+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.122+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.122+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.141+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T12:56:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.141+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.153+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.153+0000 7f35a76cfec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T12:56:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.153+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.163+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.163+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.175+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:03.198 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.175+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.196+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T12:56:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.196+0000 7f35a76cfec0 20 zonegroup default 2019-11-27T12:56:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.196+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.206+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:03.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.206+0000 7f35a76cfec0 10 Cannot find current period zone using local zone 2019-11-27T12:56:03.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.206+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.217+0000 7f35a76cfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.217+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.252 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.229+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:03.252 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.229+0000 7f35a76cfec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.246+0000 7f35a76cfec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T12:56:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.246+0000 7f35a76cfec0 20 zone default found 2019-11-27T12:56:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.246+0000 7f35a76cfec0 20 started sync module instance, tier type = 2019-11-27T12:56:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.246+0000 7f35a76cfec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T12:56:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.689+0000 7f35a76cfec0 20 add_watcher() i=0 2019-11-27T12:56:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.689+0000 7f35a76cfec0 20 add_watcher() i=1 2019-11-27T12:56:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.689+0000 7f35a76cfec0 20 add_watcher() i=2 2019-11-27T12:56:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.689+0000 7f35a76cfec0 20 add_watcher() i=3 2019-11-27T12:56:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.689+0000 7f35a76cfec0 20 add_watcher() i=4 2019-11-27T12:56:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.689+0000 7f35a76cfec0 20 add_watcher() i=5 2019-11-27T12:56:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.698+0000 7f35a76cfec0 20 add_watcher() i=6 2019-11-27T12:56:03.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.732+0000 7f35a76cfec0 20 add_watcher() i=7 2019-11-27T12:56:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.732+0000 7f35a76cfec0 2 all 8 watchers are set, enabling cache 2019-11-27T12:56:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.732+0000 7f35657e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T12:56:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.739+0000 7f35948fc700 0 -- 172.21.15.5:0/1411840549 >> v2:172.21.15.5:3300/0 conn(0x55949d472e10 msgr2=0x55949d478190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T12:56:03.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:03.941+0000 7f35948fc700 0 --2- 172.21.15.5:0/1411840549 >> v2:172.21.15.5:3300/0 conn(0x55949d472e10 0x55949d478190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T12:56:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:04.034+0000 7f35950fd700 0 -- 172.21.15.5:0/2918654433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55949d478810 msgr2=0x55949d478c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T12:56:06.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.526+0000 7f34d77fe700 20 reqs_thread_entry: start 2019-11-27T12:56:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.527+0000 7f34d57fa700 20 reqs_thread_entry: start 2019-11-27T12:56:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.527+0000 7f35a76cfec0 20 init_complete bucket index max shards: 0 2019-11-27T12:56:06.551 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.528+0000 7f34c37fe700 20 reqs_thread_entry: start 2019-11-27T12:56:06.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.746+0000 7f35a76cfec0 20 remove_watcher() i=0 2019-11-27T12:56:06.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.746+0000 7f35a76cfec0 2 removed watcher, disabling cache 2019-11-27T12:56:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.806+0000 7f35a76cfec0 20 remove_watcher() i=1 2019-11-27T12:56:06.881 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.858+0000 7f35a76cfec0 20 remove_watcher() i=2 2019-11-27T12:56:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.919+0000 7f35a76cfec0 20 remove_watcher() i=3 2019-11-27T12:56:06.987 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:06.965+0000 7f35a76cfec0 20 remove_watcher() i=4 2019-11-27T12:56:07.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.010+0000 7f35a76cfec0 20 remove_watcher() i=5 2019-11-27T12:56:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.074+0000 7f35a76cfec0 20 remove_watcher() i=6 2019-11-27T12:56:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.127+0000 7f35a76cfec0 20 remove_watcher() i=7 2019-11-27T12:56:07.159 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2019-11-27T12:56:07.159 DEBUG:tasks.util.rgw: json result: [] 2019-11-27T12:56:07.160 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-11-27T12:56:07.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-27T12:56:07.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-27T12:56:07.160 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-11-27T12:56:07.383 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.360+0000 7f2aa97fa700 20 reqs_thread_entry: start 2019-11-27T12:56:07.383 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.360+0000 7f2b335efec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.400 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.377+0000 7f2b335efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:07.400 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.377+0000 7f2b335efec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.398+0000 7f2b335efec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.398+0000 7f2b335efec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.414+0000 7f2b335efec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T12:56:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.414+0000 7f2b335efec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.432+0000 7f2b335efec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T12:56:07.541 INFO:teuthology.orchestra.run.smithi005.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-11-27T12:56:07.541 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-27T12:56:07.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-27T12:56:07.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-27T12:56:07.542 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-11-27T12:56:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.789+0000 7fb3ff7fe700 20 reqs_thread_entry: start 2019-11-27T12:56:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.789+0000 7fb4caa8bec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.817+0000 7fb4caa8bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.817+0000 7fb4caa8bec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.865 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.842+0000 7fb4caa8bec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T12:56:07.865 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.842+0000 7fb4caa8bec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.857+0000 7fb4caa8bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.857+0000 7fb4caa8bec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.879+0000 7fb4caa8bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:07.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.879+0000 7fb4caa8bec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:07.924 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:07.902+0000 7fb4caa8bec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-27T12:56:08.006 INFO:teuthology.orchestra.run.smithi005.stdout:{"id":"dc4084cb-262b-4d5b-9664-fa175bfdb24a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-27T12:56:08.007 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'dc4084cb-262b-4d5b-9664-fa175bfdb24a', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-27T12:56:08.007 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-11-27T12:56:08.007 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-27T12:56:08.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-27T12:56:08.008 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-11-27T12:56:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.228+0000 7f17327fc700 20 reqs_thread_entry: start 2019-11-27T12:56:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.228+0000 7f17fd4b3ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.270 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.248+0000 7f17fd4b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:08.270 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.248+0000 7f17fd4b3ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.273+0000 7f17fd4b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:08.295 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.273+0000 7f17fd4b3ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.288+0000 7f17fd4b3ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-27T12:56:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.288+0000 7f17fd4b3ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.330 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.308+0000 7f17fd4b3ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-27T12:56:08.393 INFO:teuthology.orchestra.run.smithi005.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-11-27T12:56:08.393 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-27T12:56:08.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-27T12:56:08.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-27T12:56:08.394 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-11-27T12:56:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.541+0000 7fb8cf7fe700 20 reqs_thread_entry: start 2019-11-27T12:56:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.541+0000 7fb99ec81ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.553+0000 7fb99ec81ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.553+0000 7fb99ec81ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.565+0000 7fb99ec81ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-27T12:56:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.565+0000 7fb99ec81ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.576+0000 7fb99ec81ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T12:56:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.576+0000 7fb99ec81ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.606 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.584+0000 7fb99ec81ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T12:56:08.606 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.584+0000 7fb99ec81ec0 20 rados->read ofs=0 len=0 2019-11-27T12:56:08.622 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T12:56:08.600+0000 7fb99ec81ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T12:56:08.677 INFO:teuthology.orchestra.run.smithi005.stdout:{"id":"dc4084cb-262b-4d5b-9664-fa175bfdb24a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-27T12:56:08.677 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'dc4084cb-262b-4d5b-9664-fa175bfdb24a', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-27T12:56:08.677 INFO:tasks.rgw:Starting rgw... 2019-11-27T12:56:08.678 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-11-27T12:56:08.678 INFO:tasks.rgw:Using civetweb as radosgw frontend 2019-11-27T12:56:08.678 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-11-27T12:56:08.678 INFO:tasks.rgw.client.0:Restarting daemon 2019-11-27T12:56:08.678 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'civetweb port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-11-27T12:56:08.682 INFO:tasks.rgw.client.0:Started 2019-11-27T12:56:08.682 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi005.front.sepia.ceph.com:80/ 2019-11-27T12:56:08.682 INFO:teuthology.orchestra.run.smithi005:> curl http://smithi005.front.sepia.ceph.com:80/ 2019-11-27T12:56:08.746 INFO:teuthology.orchestra.run.smithi005.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T12:56:08.746 INFO:teuthology.orchestra.run.smithi005.stderr: Dload Upload Total Spent Left Speed 2019-11-27T12:56:08.750 INFO:teuthology.orchestra.run.smithi005.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi005.front.sepia.ceph.com:80; Connection refused 2019-11-27T12:56:08.751 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T12:56:09.751 INFO:teuthology.orchestra.run.smithi005:> curl http://smithi005.front.sepia.ceph.com:80/ 2019-11-27T12:56:09.844 INFO:teuthology.orchestra.run.smithi005.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T12:56:09.845 INFO:teuthology.orchestra.run.smithi005.stderr: Dload Upload Total Spent Left Speed 2019-11-27T12:56:09.848 INFO:teuthology.orchestra.run.smithi005.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi005.front.sepia.ceph.com:80; Connection refused 2019-11-27T12:56:09.849 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T12:56:11.850 INFO:teuthology.orchestra.run.smithi005:> curl http://smithi005.front.sepia.ceph.com:80/ 2019-11-27T12:56:11.940 INFO:teuthology.orchestra.run.smithi005.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T12:56:11.940 INFO:teuthology.orchestra.run.smithi005.stderr: Dload Upload Total Spent Left Speed 2019-11-27T12:56:11.944 INFO:teuthology.orchestra.run.smithi005.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi005.front.sepia.ceph.com:80; Connection refused 2019-11-27T12:56:11.945 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T12:56:15.945 INFO:teuthology.orchestra.run.smithi005:> curl http://smithi005.front.sepia.ceph.com:80/ 2019-11-27T12:56:16.039 INFO:teuthology.orchestra.run.smithi005.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T12:56:16.039 INFO:teuthology.orchestra.run.smithi005.stderr: Dload Upload Total Spent Left Speed 2019-11-27T12:56:16.043 INFO:teuthology.orchestra.run.smithi005.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi005.front.sepia.ceph.com:80; Connection refused 2019-11-27T12:56:16.043 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T12:56:24.045 INFO:teuthology.orchestra.run.smithi005:> curl http://smithi005.front.sepia.ceph.com:80/ 2019-11-27T12:56:24.129 INFO:teuthology.orchestra.run.smithi005.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T12:56:24.129 INFO:teuthology.orchestra.run.smithi005.stderr: Dload Upload Total Spent Left Speed 2019-11-27T12:56:24.681 INFO:teuthology.orchestra.run.smithi005.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 388 0 --:--:-- --:--:-- --:--:-- 387 2019-11-27T12:56:24.681 INFO:teuthology.orchestra.run.smithi005.stdout:anonymous 2019-11-27T12:56:24.681 INFO:teuthology.run_tasks:Running task workunit... 2019-11-27T12:56:29.982 INFO:tasks.workunit:Pulling workunits from ref 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:56:29.983 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-11-27T12:56:29.983 INFO:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2019-11-27T12:56:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-11-27T12:56:30.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T12:56:30.061 INFO:teuthology.orchestra.run.smithi005:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-27T12:56:30.130 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-11-27T12:56:30.130 INFO:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-11-27T12:56:30.181 INFO:tasks.workunit:timeout=3h 2019-11-27T12:56:30.181 INFO:tasks.workunit:cleanup=True 2019-11-27T12:56:30.182 INFO:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T12:56:30.279 INFO:tasks.workunit.client.0.smithi005.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-11-27T12:57:05.466 INFO:tasks.workunit.client.0.smithi005.stderr:Note: checking out '00732956b62306ff37a7f7c81af9db807aae2dc8'. 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr: 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by performing another checkout. 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr: 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2019-11-27T12:57:05.467 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-11-27T12:57:05.468 INFO:tasks.workunit.client.0.smithi005.stderr: 2019-11-27T12:57:05.468 INFO:tasks.workunit.client.0.smithi005.stderr: git checkout -b new_branch_name 2019-11-27T12:57:05.468 INFO:tasks.workunit.client.0.smithi005.stderr: 2019-11-27T12:57:05.468 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 0073295... rgw: fix a bug that bucket instance obj can't be removed after resharding completed. 2019-11-27T12:57:05.469 INFO:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-11-27T12:57:05.526 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-11-27T12:57:05.534 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-27T12:57:05.534 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-11-27T12:57:06.025 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-11-27T12:57:06.092 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-11-27T12:57:06.132 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-27T12:57:06.134 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-27T12:57:06.134 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-11-27T12:57:06.171 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-27T12:57:06.229 DEBUG:teuthology.orchestra.remote:smithi005:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-11-27T12:57:06.282 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-11-27T12:57:06.283 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-11-27T12:57:06.283 INFO:teuthology.orchestra.run.smithi005:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-11-27T12:57:06.345 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2019-11-27T12:57:06.346 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 11 tests from 1 test suite. 2019-11-27T12:57:06.346 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2019-11-27T12:57:06.346 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 11 tests from ClsLock 2019-11-27T12:57:06.346 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-11-27T12:57:08.429 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:08.429 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: exclusive 2019-11-27T12:57:08.430 INFO:tasks.workunit.client.0.smithi005.stdout: tag: 2019-11-27T12:57:08.430 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:08.430 INFO:tasks.workunit.client.0.smithi005.stdout: client.4509 expiration=2019-11-27T12:59:08.250968+0000 addr=v1:172.21.15.5:0/1247027473 cookie= 2019-11-27T12:57:08.708 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:08.709 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: shared 2019-11-27T12:57:08.709 INFO:tasks.workunit.client.0.smithi005.stdout: tag: 2019-11-27T12:57:08.709 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:08.709 INFO:tasks.workunit.client.0.smithi005.stdout: client.4507 expiration=0.000000 addr=v1:172.21.15.5:0/1281002114 cookie= 2019-11-27T12:57:08.709 INFO:tasks.workunit.client.0.smithi005.stdout: client.4509 expiration=2019-11-27T12:59:08.590585+0000 addr=v1:172.21.15.5:0/1247027473 cookie= 2019-11-27T12:57:08.779 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:08.779 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: shared 2019-11-27T12:57:08.779 INFO:tasks.workunit.client.0.smithi005.stdout: tag: 2019-11-27T12:57:08.779 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:08.780 INFO:tasks.workunit.client.0.smithi005.stdout: client.4507 expiration=0.000000 addr=v1:172.21.15.5:0/1281002114 cookie= 2019-11-27T12:57:10.118 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestMultiLocking (3773 ms) 2019-11-27T12:57:10.118 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestMeta 2019-11-27T12:57:13.065 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:13.066 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: shared 2019-11-27T12:57:13.066 INFO:tasks.workunit.client.0.smithi005.stdout: tag: 2019-11-27T12:57:13.066 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:13.066 INFO:tasks.workunit.client.0.smithi005.stdout: client.4513 expiration=0.000000 addr=v1:172.21.15.5:0/1876932423 cookie= 2019-11-27T12:57:13.142 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:13.142 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: exclusive 2019-11-27T12:57:13.142 INFO:tasks.workunit.client.0.smithi005.stdout: tag: new_tag 2019-11-27T12:57:13.142 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:13.142 INFO:tasks.workunit.client.0.smithi005.stdout: client.4376 expiration=0.000000 addr=v1:172.21.15.5:0/2752249062 cookie= 2019-11-27T12:57:13.508 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestMeta (3390 ms) 2019-11-27T12:57:13.509 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestCookie 2019-11-27T12:57:16.599 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:16.600 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: exclusive 2019-11-27T12:57:16.600 INFO:tasks.workunit.client.0.smithi005.stdout: tag: 2019-11-27T12:57:16.600 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:16.667 INFO:tasks.workunit.client.0.smithi005.stdout:lock: mylock 2019-11-27T12:57:16.668 INFO:tasks.workunit.client.0.smithi005.stdout: lock_type: shared 2019-11-27T12:57:16.668 INFO:tasks.workunit.client.0.smithi005.stdout: tag: 2019-11-27T12:57:16.668 INFO:tasks.workunit.client.0.smithi005.stdout: lockers: 2019-11-27T12:57:16.668 INFO:tasks.workunit.client.0.smithi005.stdout: client.4516 expiration=0.000000 addr=v1:172.21.15.5:0/3356803476 cookie= 2019-11-27T12:57:16.668 INFO:tasks.workunit.client.0.smithi005.stdout: client.4516 expiration=0.000000 addr=v1:172.21.15.5:0/3356803476 cookie=new cookie 2019-11-27T12:57:17.099 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestCookie (3591 ms) 2019-11-27T12:57:17.100 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-11-27T12:57:20.571 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestMultipleLocks (3472 ms) 2019-11-27T12:57:20.571 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestLockDuration 2019-11-27T12:57:28.707 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestLockDuration (8135 ms) 2019-11-27T12:57:28.707 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-11-27T12:57:32.293 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestAssertLocked (3585 ms) 2019-11-27T12:57:32.293 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestSetCookie 2019-11-27T12:57:35.601 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestSetCookie (3309 ms) 2019-11-27T12:57:35.602 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestRenew 2019-11-27T12:57:57.850 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestRenew (22248 ms) 2019-11-27T12:57:57.850 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-11-27T12:58:06.088 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (8237 ms) 2019-11-27T12:58:06.088 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-11-27T12:58:14.518 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8430 ms) 2019-11-27T12:58:14.518 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-11-27T12:58:23.207 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8688 ms) 2019-11-27T12:58:23.207 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 11 tests from ClsLock (76858 ms total) 2019-11-27T12:58:23.208 INFO:tasks.workunit.client.0.smithi005.stdout: 2019-11-27T12:58:23.208 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2019-11-27T12:58:23.208 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 11 tests from 1 test suite ran. (76858 ms total) 2019-11-27T12:58:23.208 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 11 tests. 2019-11-27T12:58:23.210 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T12:58:23.210 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T12:58:23.393 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-11-27T12:58:23.393 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-11-27T12:58:23.394 INFO:teuthology.orchestra.run.smithi005:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-11-27T12:58:23.472 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2019-11-27T12:58:23.473 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 4 tests from 1 test suite. 2019-11-27T12:58:23.473 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2019-11-27T12:58:23.473 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from cls_log 2019-11-27T12:58:23.473 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-11-27T12:58:26.585 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_log.test_log_add_same_time (3112 ms) 2019-11-27T12:58:26.585 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-11-27T12:58:31.101 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_log.test_log_add_different_time (4513 ms) 2019-11-27T12:58:31.101 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_log.trim_by_time 2019-11-27T12:58:37.117 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_log.trim_by_time (6019 ms) 2019-11-27T12:58:37.118 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_log.trim_by_marker 2019-11-27T12:58:41.731 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_log.trim_by_marker (4613 ms) 2019-11-27T12:58:41.731 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from cls_log (18257 ms total) 2019-11-27T12:58:41.731 INFO:tasks.workunit.client.0.smithi005.stdout: 2019-11-27T12:58:41.732 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2019-11-27T12:58:41.732 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 4 tests from 1 test suite ran. (18257 ms total) 2019-11-27T12:58:41.732 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 4 tests. 2019-11-27T12:58:41.734 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T12:58:41.734 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T12:58:41.802 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-11-27T12:58:41.803 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-11-27T12:58:41.803 INFO:teuthology.orchestra.run.smithi005:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-11-27T12:58:41.856 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2019-11-27T12:58:41.856 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 5 tests from 1 test suite. 2019-11-27T12:58:41.857 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2019-11-27T12:58:41.857 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from cls_rgw 2019-11-27T12:58:41.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.test_implicit 2019-11-27T12:58:45.179 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.test_implicit (3322 ms) 2019-11-27T12:58:45.179 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-11-27T12:58:48.642 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3463 ms) 2019-11-27T12:58:48.642 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.test_put_snap 2019-11-27T12:58:56.858 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T12:58:56.812+0000 3aa7e700 -1 osd.5 pg_epoch: 106 pg[25.6( v 105'4 (0'0,105'4] local-lis/les=102/103 n=2 ec=102/102 lis/c=102/102 les/c/f=103/103/0 sis=102) [5,1] r=0 lpr=102 crt=104'3 lcod 104'3 mlcod 104'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-11-27T12:58:58.260 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.test_put_snap (9617 ms) 2019-11-27T12:58:58.260 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.test_explicit 2019-11-27T12:59:01.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.test_explicit (3685 ms) 2019-11-27T12:59:01.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.set 2019-11-27T12:59:05.325 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.set (3380 ms) 2019-11-27T12:59:05.325 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from cls_rgw (23467 ms total) 2019-11-27T12:59:05.325 INFO:tasks.workunit.client.0.smithi005.stdout: 2019-11-27T12:59:05.326 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2019-11-27T12:59:05.326 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 5 tests from 1 test suite ran. (23468 ms total) 2019-11-27T12:59:05.326 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 5 tests. 2019-11-27T12:59:05.327 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T12:59:05.328 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T12:59:05.446 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-11-27T12:59:05.447 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-11-27T12:59:05.447 INFO:teuthology.orchestra.run.smithi005:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-11-27T12:59:05.504 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2019-11-27T12:59:05.505 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 13 tests from 1 test suite. 2019-11-27T12:59:05.505 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2019-11-27T12:59:05.505 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 13 tests from cls_rgw 2019-11-27T12:59:07.588 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.index_basic 2019-11-27T12:59:09.652 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.index_basic (2063 ms) 2019-11-27T12:59:09.652 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-11-27T12:59:11.718 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (2066 ms) 2019-11-27T12:59:11.718 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.index_remove_object 2019-11-27T12:59:14.585 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.index_remove_object (2867 ms) 2019-11-27T12:59:14.585 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.index_suggest 2019-11-27T12:59:56.433 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.index_suggest (41846 ms) 2019-11-27T12:59:56.433 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.index_list 2019-11-27T12:59:57.566 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.index_list (1133 ms) 2019-11-27T12:59:57.566 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.bi_list 2019-11-27T13:00:01.846 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.bi_list (4280 ms) 2019-11-27T13:00:01.847 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.gc_set 2019-11-27T13:00:02.583 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.gc_set (736 ms) 2019-11-27T13:00:02.583 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.gc_list 2019-11-27T13:00:03.353 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.gc_list (771 ms) 2019-11-27T13:00:03.354 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.gc_defer 2019-11-27T13:00:12.148 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.gc_defer (8793 ms) 2019-11-27T13:00:12.148 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.usage_basic 2019-11-27T13:00:21.407 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.usage_basic (9259 ms) 2019-11-27T13:00:21.407 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-11-27T13:00:21.439 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.usage_clear_no_obj (33 ms) 2019-11-27T13:00:21.439 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.usage_clear 2019-11-27T13:00:28.685 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.usage_clear (7245 ms) 2019-11-27T13:00:28.685 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-11-27T13:00:31.696 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] cls_rgw.bi_log_trim (3011 ms) 2019-11-27T13:00:32.124 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 13 tests from cls_rgw (84103 ms total) 2019-11-27T13:00:32.124 INFO:tasks.workunit.client.0.smithi005.stdout: 2019-11-27T13:00:32.125 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2019-11-27T13:00:32.125 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 13 tests from 1 test suite ran. (86615 ms total) 2019-11-27T13:00:32.125 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 13 tests. 2019-11-27T13:00:32.126 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T13:00:32.127 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T13:00:32.245 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-11-27T13:00:32.246 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-11-27T13:00:32.246 INFO:teuthology.orchestra.run.smithi005:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-11-27T13:00:32.328 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 6 tests from 1 test suite. 2019-11-27T13:00:32.329 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2019-11-27T13:00:34.766 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 6 tests from rgw_gc_log 2019-11-27T13:00:34.766 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-11-27T13:00:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] rgw_gc_log.init_existing_queue (546 ms) 2019-11-27T13:00:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-11-27T13:00:35.484 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] rgw_gc_log.init_existing_omap (171 ms) 2019-11-27T13:00:35.484 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-11-27T13:00:35.624 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (141 ms) 2019-11-27T13:00:35.624 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-11-27T13:00:35.693 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (68 ms) 2019-11-27T13:00:35.693 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-11-27T13:00:36.143 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] rgw_gc_log.defer1_after_init (450 ms) 2019-11-27T13:00:36.143 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-11-27T13:00:36.406 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] rgw_gc_log.defer2_before_init (264 ms) 2019-11-27T13:00:36.406 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 6 tests from rgw_gc_log (1640 ms total) 2019-11-27T13:00:36.407 INFO:tasks.workunit.client.0.smithi005.stdout: 2019-11-27T13:00:36.407 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2019-11-27T13:00:37.128 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 6 tests from 1 test suite ran. (4799 ms total) 2019-11-27T13:00:37.128 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 6 tests. 2019-11-27T13:00:37.130 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T13:00:37.130 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T13:00:37.199 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-11-27T13:00:37.199 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-11-27T13:00:37.486 DEBUG:teuthology.parallel:result is None 2019-11-27T13:00:37.487 INFO:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-11-27T13:00:37.559 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-11-27T13:00:37.559 INFO:teuthology.orchestra.run.smithi005:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-27T13:00:37.609 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-11-27T13:00:37.609 INFO:teuthology.run_tasks:Running task ragweed... 2019-11-27T13:00:37.625 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-11-27T13:00:37.625 INFO:tasks.ragweed:Downloading ragweed... 2019-11-27T13:00:37.625 INFO:tasks.ragweed:Using branch 'wip-mkogan-testing' for ragweed 2019-11-27T13:00:37.626 INFO:teuthology.orchestra.run.smithi005:> git clone -b wip-mkogan-testing git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-27T13:00:37.694 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-11-27T13:00:37.694 INFO:teuthology.orchestra.run.smithi005.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-27T13:00:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:fatal: Remote branch wip-mkogan-testing not found in upstream origin 2019-11-27T13:00:37.694 INFO:teuthology.orchestra.run.smithi005:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-27T13:00:37.795 INFO:teuthology.orchestra.run.smithi005.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-27T13:00:37.874 INFO:tasks.ragweed:Creating rgw users... 2019-11-27T13:00:37.875 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-11-27T13:00:37.875 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ICXTOYVNYTQDYKNIGOWF --secret A5o0si1h1Hm7XY7fBj2bp5EgQjGb+nfn1ZWkd+AOIvJGNF6lYXGP2Q== --email sysuser.client.0+test@test.test --system true 2019-11-27T13:00:38.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:37.983+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.008+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.008+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.014+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.014+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.019+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.019+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.031+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.187+0000 7fb5e8d5cec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:00:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.187+0000 7fb5e8d5cec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:00:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.187+0000 7fb5e8d5cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:00:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.187+0000 7fb5e8d5cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:00:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.188+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.238 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.201+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:38.238 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.201+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.219+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:00:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.219+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.231+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.231+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.284 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.247+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:00:38.284 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.247+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.258+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.258+0000 7fb5e8d5cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:00:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.258+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.268+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.268+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.320 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.284+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.284+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.293+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:00:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.293+0000 7fb5e8d5cec0 20 zonegroup default 2019-11-27T13:00:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.293+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.305+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.305+0000 7fb5e8d5cec0 10 Cannot find current period zone using local zone 2019-11-27T13:00:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.305+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.317+0000 7fb5e8d5cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:38.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.317+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.336+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.336+0000 7fb5e8d5cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.353+0000 7fb5e8d5cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:00:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.353+0000 7fb5e8d5cec0 20 zone default found 2019-11-27T13:00:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.353+0000 7fb5e8d5cec0 20 started sync module instance, tier type = 2019-11-27T13:00:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.353+0000 7fb5e8d5cec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:00:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=0 2019-11-27T13:00:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=1 2019-11-27T13:00:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=2 2019-11-27T13:00:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=3 2019-11-27T13:00:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=4 2019-11-27T13:00:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=5 2019-11-27T13:00:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.728+0000 7fb5e8d5cec0 20 add_watcher() i=6 2019-11-27T13:00:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.758+0000 7fb5e8d5cec0 20 add_watcher() i=7 2019-11-27T13:00:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.758+0000 7fb5e8d5cec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:00:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.758+0000 7fb5a67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:00:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.760+0000 7fb5d678a700 0 -- 172.21.15.5:0/3191743548 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x561b5424bff0 msgr2=0x561b5424c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T13:00:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:38.798+0000 7fb5d5f89700 0 -- 172.21.15.5:0/798829549 >> [v2:172.21.15.115:6824/9158,v1:172.21.15.115:6825/9158] conn(0x561b54264650 msgr2=0x561b54266a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T13:00:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.729+0000 7fb51cff9700 20 reqs_thread_entry: start 2019-11-27T13:00:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.729+0000 7fb5167fc700 20 reqs_thread_entry: start 2019-11-27T13:00:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.729+0000 7fb5e8d5cec0 20 init_complete bucket index max shards: 0 2019-11-27T13:00:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.730+0000 7fb514ff9700 20 reqs_thread_entry: start 2019-11-27T13:00:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.730+0000 7fb5e8d5cec0 20 get_system_obj_state: rctx=0x7ffff28fd498 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x561b542cb150 s->prefetch_data=0 2019-11-27T13:00:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.730+0000 7fb5e8d5cec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-27T13:00:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.742+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-11-27T13:00:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.742+0000 7fb5e8d5cec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T13:00:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.742+0000 7fb5e8d5cec0 20 get_system_obj_state: rctx=0x7ffff28fd4a8 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x561b542ccee0 s->prefetch_data=0 2019-11-27T13:00:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.742+0000 7fb5e8d5cec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-11-27T13:00:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.749+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-11-27T13:00:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.749+0000 7fb5e8d5cec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-27T13:00:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.749+0000 7fb5e8d5cec0 20 get_system_obj_state: rctx=0x7ffff28fd4a8 obj=default.rgw.meta:users.keys:ICXTOYVNYTQDYKNIGOWF state=0x561b542ccee0 s->prefetch_data=0 2019-11-27T13:00:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.749+0000 7fb5e8d5cec0 10 cache get: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF : miss 2019-11-27T13:00:40.791 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.754+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF info.flags=0x0 2019-11-27T13:00:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.754+0000 7fb5e8d5cec0 10 adding default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF to cache LRU end 2019-11-27T13:00:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.754+0000 7fb5e8d5cec0 20 get_system_obj_state: rctx=0x7ffff28fd0b8 obj=default.rgw.meta:users.keys:ICXTOYVNYTQDYKNIGOWF state=0x561b542ccee0 s->prefetch_data=0 2019-11-27T13:00:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.754+0000 7fb5e8d5cec0 10 cache get: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF : type miss (requested=0x6, cached=0x0) 2019-11-27T13:00:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.765+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF info.flags=0x0 2019-11-27T13:00:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.765+0000 7fb5e8d5cec0 10 moving default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF to cache LRU end 2019-11-27T13:00:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.765+0000 7fb5e8d5cec0 20 get_system_obj_state: rctx=0x7ffff28fd238 obj=default.rgw.meta:users.keys:ICXTOYVNYTQDYKNIGOWF state=0x561b542ccee0 s->prefetch_data=0 2019-11-27T13:00:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.765+0000 7fb5e8d5cec0 10 cache get: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF : type miss (requested=0x6, cached=0x0) 2019-11-27T13:00:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.788+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF info.flags=0x0 2019-11-27T13:00:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.788+0000 7fb5e8d5cec0 10 moving default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF to cache LRU end 2019-11-27T13:00:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.851+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-27T13:00:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.851+0000 7fb5e8d5cec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T13:00:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.851+0000 7fb5e8d5cec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-11-27T13:00:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.877+0000 7fb5b6ffd700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94675375734416 notifier 4439 bl.length()=637 2019-11-27T13:00:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.877+0000 7fb5b6ffd700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-27T13:00:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:40.877+0000 7fb5b6ffd700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T13:00:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.106+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-27T13:00:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.106+0000 7fb5e8d5cec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-27T13:00:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.106+0000 7fb5e8d5cec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-11-27T13:00:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.118+0000 7fb5b6ffd700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94675375739632 notifier 4439 bl.length()=202 2019-11-27T13:00:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.118+0000 7fb5b6ffd700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-27T13:00:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.118+0000 7fb5b6ffd700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-27T13:00:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.319+0000 7fb5e8d5cec0 10 cache put: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF info.flags=0x7 2019-11-27T13:00:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.319+0000 7fb5e8d5cec0 10 moving default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF to cache LRU end 2019-11-27T13:00:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.319+0000 7fb5e8d5cec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2019-11-27T13:00:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.333+0000 7fb5b6ffd700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94675375739632 notifier 4439 bl.length()=190 2019-11-27T13:00:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.333+0000 7fb5b6ffd700 10 cache put: name=default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF info.flags=0x7 2019-11-27T13:00:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.333+0000 7fb5b6ffd700 10 moving default.rgw.meta+users.keys+ICXTOYVNYTQDYKNIGOWF to cache LRU end 2019-11-27T13:00:41.866 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T13:00:41.866 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "sysuser.client.0", 2019-11-27T13:00:41.866 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. sysuser.client.0", 2019-11-27T13:00:41.866 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "sysuser.client.0+test@test.test", 2019-11-27T13:00:41.866 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T13:00:41.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [], 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [ 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "sysuser.client.0", 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "ICXTOYVNYTQDYKNIGOWF", 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "A5o0si1h1Hm7XY7fBj2bp5EgQjGb+nfn1ZWkd+AOIvJGNF6lYXGP2Q==" 2019-11-27T13:00:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [], 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "system": "true", 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T13:00:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T13:00:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T13:00:41.870 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T13:00:41.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T13:00:41.871 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T13:00:41.871 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T13:00:41.871 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:00:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.876+0000 7fb5e8d5cec0 20 remove_watcher() i=0 2019-11-27T13:00:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.876+0000 7fb5e8d5cec0 2 removed watcher, disabling cache 2019-11-27T13:00:41.966 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.930+0000 7fb5e8d5cec0 20 remove_watcher() i=1 2019-11-27T13:00:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:41.989+0000 7fb5e8d5cec0 20 remove_watcher() i=2 2019-11-27T13:00:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.064+0000 7fb5e8d5cec0 20 remove_watcher() i=3 2019-11-27T13:00:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.128+0000 7fb5e8d5cec0 20 remove_watcher() i=4 2019-11-27T13:00:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.190+0000 7fb5e8d5cec0 20 remove_watcher() i=5 2019-11-27T13:00:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.241+0000 7fb5e8d5cec0 20 remove_watcher() i=6 2019-11-27T13:00:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.286+0000 7fb5e8d5cec0 20 remove_watcher() i=7 2019-11-27T13:00:42.330 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-11-27T13:00:42.330 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key QQRJHMMZNBMEAIVVSIAY --secret SKYVkpSKbzw0Wv+KF4T5ujpq0r0xKoCEH6gY1T8+vBXfAWqaYRizCg== --email ragweed.client.0+test@test.test --system false 2019-11-27T13:00:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.461+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.490+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.490+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.499+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.499+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.509+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.509+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.530+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.732+0000 7faa3536cec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:00:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.732+0000 7faa3536cec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:00:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.732+0000 7faa3536cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:00:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.732+0000 7faa3536cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:00:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.732+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.747+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.747+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.758+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:00:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.759+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.776+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.776+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.791+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:00:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.791+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.803+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.803+0000 7faa3536cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:00:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.803+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.815+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.815+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.833+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.833+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.851+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:00:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.851+0000 7faa3536cec0 20 zonegroup default 2019-11-27T13:00:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.851+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.863+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.863+0000 7faa3536cec0 10 Cannot find current period zone using local zone 2019-11-27T13:00:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.863+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.875+0000 7faa3536cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:00:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.875+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.893+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:00:42.930 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.893+0000 7faa3536cec0 20 rados->read ofs=0 len=0 2019-11-27T13:00:42.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.913+0000 7faa3536cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:00:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.913+0000 7faa3536cec0 20 zone default found 2019-11-27T13:00:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.913+0000 7faa3536cec0 20 started sync module instance, tier type = 2019-11-27T13:00:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:42.913+0000 7faa3536cec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:00:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=0 2019-11-27T13:00:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=1 2019-11-27T13:00:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=2 2019-11-27T13:00:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=3 2019-11-27T13:00:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=4 2019-11-27T13:00:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=5 2019-11-27T13:00:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.310+0000 7faa3536cec0 20 add_watcher() i=6 2019-11-27T13:00:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.341+0000 7faa3536cec0 20 add_watcher() i=7 2019-11-27T13:00:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.341+0000 7faa3536cec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:00:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.341+0000 7fa9f2fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:00:43.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.354+0000 7faa21d98700 0 -- >> v1:172.21.15.115:6789/0 conn(0x561618def370 legacy=0x561618df1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T13:00:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:43.456+0000 7faa22d9a700 0 -- 172.21.15.5:0/2413831930 >> [v2:172.21.15.115:6800/9159,v1:172.21.15.115:6801/9159] conn(0x561618dfa8d0 msgr2=0x561618e00f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:00:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.302+0000 7fa9617fa700 20 reqs_thread_entry: start 2019-11-27T13:00:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.303+0000 7fa95affd700 20 reqs_thread_entry: start 2019-11-27T13:00:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.303+0000 7faa3536cec0 20 init_complete bucket index max shards: 0 2019-11-27T13:00:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.304+0000 7fa9597fa700 20 reqs_thread_entry: start 2019-11-27T13:00:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.304+0000 7faa3536cec0 20 get_system_obj_state: rctx=0x7fff689418a8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x561618e64ec0 s->prefetch_data=0 2019-11-27T13:00:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.304+0000 7faa3536cec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-27T13:00:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.313+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-11-27T13:00:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.313+0000 7faa3536cec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T13:00:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.313+0000 7faa3536cec0 20 get_system_obj_state: rctx=0x7fff689418b8 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x561618e66c50 s->prefetch_data=0 2019-11-27T13:00:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.313+0000 7faa3536cec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-11-27T13:00:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.321+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-11-27T13:00:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.321+0000 7faa3536cec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-27T13:00:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.321+0000 7faa3536cec0 20 get_system_obj_state: rctx=0x7fff689418b8 obj=default.rgw.meta:users.keys:QQRJHMMZNBMEAIVVSIAY state=0x561618e66c50 s->prefetch_data=0 2019-11-27T13:00:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.321+0000 7faa3536cec0 10 cache get: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY : miss 2019-11-27T13:00:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.340+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY info.flags=0x0 2019-11-27T13:00:45.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.340+0000 7faa3536cec0 10 adding default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY to cache LRU end 2019-11-27T13:00:45.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.340+0000 7faa3536cec0 20 get_system_obj_state: rctx=0x7fff689414c8 obj=default.rgw.meta:users.keys:QQRJHMMZNBMEAIVVSIAY state=0x561618e66c50 s->prefetch_data=0 2019-11-27T13:00:45.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.340+0000 7faa3536cec0 10 cache get: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY : type miss (requested=0x6, cached=0x0) 2019-11-27T13:00:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.351+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY info.flags=0x0 2019-11-27T13:00:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.351+0000 7faa3536cec0 10 moving default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY to cache LRU end 2019-11-27T13:00:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.351+0000 7faa3536cec0 20 get_system_obj_state: rctx=0x7fff68941648 obj=default.rgw.meta:users.keys:QQRJHMMZNBMEAIVVSIAY state=0x561618e66c50 s->prefetch_data=0 2019-11-27T13:00:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.351+0000 7faa3536cec0 10 cache get: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY : type miss (requested=0x6, cached=0x0) 2019-11-27T13:00:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.359+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY info.flags=0x0 2019-11-27T13:00:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.359+0000 7faa3536cec0 10 moving default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY to cache LRU end 2019-11-27T13:00:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.424+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-27T13:00:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.424+0000 7faa3536cec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T13:00:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.424+0000 7faa3536cec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-11-27T13:00:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.437+0000 7faa037fe700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94652906422656 notifier 4671 bl.length()=637 2019-11-27T13:00:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.437+0000 7faa037fe700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-27T13:00:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:45.437+0000 7faa037fe700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T13:00:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.184+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-27T13:00:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.184+0000 7faa3536cec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-27T13:00:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.184+0000 7faa3536cec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-11-27T13:00:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.206+0000 7faa037fe700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94652906417456 notifier 4671 bl.length()=202 2019-11-27T13:00:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.206+0000 7faa037fe700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-27T13:00:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.206+0000 7faa037fe700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-27T13:00:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.726+0000 7faa3536cec0 10 cache put: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY info.flags=0x7 2019-11-27T13:00:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.726+0000 7faa3536cec0 10 moving default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY to cache LRU end 2019-11-27T13:00:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.726+0000 7faa3536cec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=190 2019-11-27T13:00:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.782+0000 7faa037fe700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94652906425024 notifier 4671 bl.length()=190 2019-11-27T13:00:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.782+0000 7faa037fe700 10 cache put: name=default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY info.flags=0x7 2019-11-27T13:00:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:46.782+0000 7faa037fe700 10 moving default.rgw.meta+users.keys+QQRJHMMZNBMEAIVVSIAY to cache LRU end 2019-11-27T13:00:47.007 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T13:00:47.008 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "ragweed.client.0", 2019-11-27T13:00:47.008 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. ragweed.client.0", 2019-11-27T13:00:47.008 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "ragweed.client.0+test@test.test", 2019-11-27T13:00:47.008 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T13:00:47.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T13:00:47.008 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [], 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [ 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "ragweed.client.0", 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "QQRJHMMZNBMEAIVVSIAY", 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "SKYVkpSKbzw0Wv+KF4T5ujpq0r0xKoCEH6gY1T8+vBXfAWqaYRizCg==" 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T13:00:47.009 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [], 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "system": "true", 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T13:00:47.010 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T13:00:47.011 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T13:00:47.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T13:00:47.013 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T13:00:47.013 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T13:00:47.013 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:00:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.029+0000 7faa3536cec0 20 remove_watcher() i=0 2019-11-27T13:00:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.029+0000 7faa3536cec0 2 removed watcher, disabling cache 2019-11-27T13:00:47.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.118+0000 7faa3536cec0 20 remove_watcher() i=1 2019-11-27T13:00:47.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.167+0000 7faa3536cec0 20 remove_watcher() i=2 2019-11-27T13:00:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.234+0000 7faa3536cec0 20 remove_watcher() i=3 2019-11-27T13:00:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.293+0000 7faa3536cec0 20 remove_watcher() i=4 2019-11-27T13:00:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.366+0000 7faa3536cec0 20 remove_watcher() i=5 2019-11-27T13:00:47.471 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.433+0000 7faa3536cec0 20 remove_watcher() i=6 2019-11-27T13:00:47.519 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:00:47.481+0000 7faa3536cec0 20 remove_watcher() i=7 2019-11-27T13:00:47.529 INFO:tasks.ragweed:Configuring ragweed... 2019-11-27T13:00:47.529 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-11-27T13:00:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-27T13:00:54.321 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T13:00:54.363 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T13:00:54.364 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T13:00:54.364 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T13:00:54.364 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T13:00:54.365 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T13:00:55.029 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T13:00:55.389 INFO:teuthology.orchestra.run.smithi005.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-11-27T13:00:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T13:00:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T13:00:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-11-27T13:00:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-11-27T13:00:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-11-27T13:00:56.387 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-11-27T13:00:56.388 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-11-27T13:00:56.391 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-27T13:00:56.391 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T13:00:56.392 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-11-27T13:00:56.394 INFO:teuthology.orchestra.run.smithi005.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-11-27T13:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-11-27T13:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T13:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-11-27T13:00:56.843 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T13:00:57.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:00:57.052 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T13:00:57.053 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:00:57.053 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T13:00:57.053 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-11-27T13:00:57.054 INFO:teuthology.orchestra.run.smithi005.stdout:Installing for dependencies: 2019-11-27T13:00:57.055 INFO:teuthology.orchestra.run.smithi005.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-11-27T13:00:57.055 INFO:teuthology.orchestra.run.smithi005.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-11-27T13:00:57.055 INFO:teuthology.orchestra.run.smithi005.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-11-27T13:00:57.055 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:00:57.055 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T13:00:57.055 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T13:00:57.056 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages (+3 Dependent packages) 2019-11-27T13:00:57.056 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:00:57.056 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.7 M 2019-11-27T13:00:57.057 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 12 M 2019-11-27T13:00:57.057 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T13:00:57.465 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2019-11-27T13:00:57.465 INFO:teuthology.orchestra.run.smithi005.stdout:Total 4.1 MB/s | 1.7 MB 00:00 2019-11-27T13:00:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T13:00:57.481 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T13:00:57.534 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T13:00:57.534 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T13:00:58.108 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-11-27T13:00:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-11-27T13:00:58.746 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-27T13:00:59.346 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-11-27T13:00:59.837 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-11-27T13:01:00.167 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-11-27T13:01:00.450 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-11-27T13:01:00.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-11-27T13:01:00.674 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-11-27T13:01:00.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-27T13:01:00.892 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-11-27T13:01:01.025 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-11-27T13:01:01.135 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-11-27T13:01:01.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-11-27T13:01:01.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:01.593 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T13:01:01.593 INFO:teuthology.orchestra.run.smithi005.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout:Dependency Installed: 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:01.594 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T13:01:01.807 INFO:teuthology.orchestra.run.smithi005.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-11-27T13:01:03.260 INFO:teuthology.orchestra.run.smithi005.stdout:Installing setuptools, pip, wheel...done. 2019-11-27T13:01:03.784 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting pip 2019-11-27T13:01:03.878 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-11-27T13:01:04.081 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: pip 2019-11-27T13:01:04.081 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: pip 9.0.1 2019-11-27T13:01:04.150 INFO:teuthology.orchestra.run.smithi005.stdout: Uninstalling pip-9.0.1: 2019-11-27T13:01:04.195 INFO:teuthology.orchestra.run.smithi005.stdout: Successfully uninstalled pip-9.0.1 2019-11-27T13:01:04.793 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed pip-19.3.1 2019-11-27T13:01:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T13:01:05.621 INFO:teuthology.orchestra.run.smithi005.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-11-27T13:01:06.539 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T13:01:06.729 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting nose 2019-11-27T13:01:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-11-27T13:01:06.911 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: nose 2019-11-27T13:01:06.986 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed nose-1.3.7 2019-11-27T13:01:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T13:01:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting setuptools==32.3.1 2019-11-27T13:01:08.134 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-11-27T13:01:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-27T13:01:08.335 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: setuptools 2019-11-27T13:01:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: setuptools 28.8.0 2019-11-27T13:01:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: Uninstalling setuptools-28.8.0: 2019-11-27T13:01:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-27T13:01:08.501 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed setuptools-32.3.1 2019-11-27T13:01:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T13:01:09.374 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting PyYAML 2019-11-27T13:01:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/e3/e8/b3212641ee2718d556df0f23f78de8303f068fe29cdaa7a91018849582fe/PyYAML-5.1.2.tar.gz (265kB) 2019-11-27T13:01:10.111 INFO:teuthology.orchestra.run.smithi005.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-11-27T13:01:10.295 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-11-27T13:01:10.308 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-11-27T13:01:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting bunch>=1.0.0 2019-11-27T13:01:10.603 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-11-27T13:01:11.283 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting gevent>=1.0 2019-11-27T13:01:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-11-27T13:01:11.832 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting httplib2 2019-11-27T13:01:11.844 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-11-27T13:01:13.173 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting lxml 2019-11-27T13:01:13.183 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-11-27T13:01:13.692 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-27T13:01:13.704 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T13:01:13.777 INFO:teuthology.orchestra.run.smithi005.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-11-27T13:01:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for PyYAML (setup.py): started 2019-11-27T13:01:14.517 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-11-27T13:01:14.518 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=46204 sha256=e049a5aaf4b0cb290a43e10950c6d43da97a84ea469d7843562c80a7ee2259af 2019-11-27T13:01:14.518 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030 2019-11-27T13:01:14.545 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for bunch (setup.py): started 2019-11-27T13:01:14.859 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-11-27T13:01:14.860 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=33d13a6dc393d8e00385e41d07b60a8cb7b00a4b6b9c533d72d1a835767c860d 2019-11-27T13:01:14.860 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-11-27T13:01:14.863 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for httplib2 (setup.py): started 2019-11-27T13:01:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-11-27T13:01:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=4fefc6bc54fcb877b00769238d2fdf0caa4bd9106590cd0eb421174e84276935 2019-11-27T13:01:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-11-27T13:01:15.192 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully built PyYAML bunch httplib2 2019-11-27T13:01:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-27T13:01:15.299 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-11-27T13:01:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: PyYAML 3.10 2019-11-27T13:01:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-27T13:01:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-11-27T13:01:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: lxml 3.2.1 2019-11-27T13:01:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-27T13:01:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-11-27T13:01:16.475 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-11-27T13:01:16.915 INFO:teuthology.orchestra.run.smithi005.stdout:running develop 2019-11-27T13:01:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:running egg_info 2019-11-27T13:01:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:creating ragweed.egg-info 2019-11-27T13:01:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-11-27T13:01:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:writing ragweed.egg-info/PKG-INFO 2019-11-27T13:01:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-11-27T13:01:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-11-27T13:01:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-27T13:01:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-27T13:01:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-27T13:01:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:running build_ext 2019-11-27T13:01:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-11-27T13:01:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-11-27T13:01:16.987 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-11-27T13:01:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:Processing dependencies for ragweed==0.0.1 2019-11-27T13:01:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for isodate>=0.4.4 2019-11-27T13:01:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-11-27T13:01:17.118 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-11-27T13:01:17.181 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: isodate 0.6.0 2019-11-27T13:01:17.182 INFO:teuthology.orchestra.run.smithi005.stdout:Processing isodate-0.6.0.tar.gz 2019-11-27T13:01:17.193 INFO:teuthology.orchestra.run.smithi005.stdout:Writing /tmp/easy_install-xpvrId/isodate-0.6.0/setup.cfg 2019-11-27T13:01:17.193 INFO:teuthology.orchestra.run.smithi005.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-xpvrId/isodate-0.6.0/egg-dist-tmp-90ckGz 2019-11-27T13:01:17.676 INFO:teuthology.orchestra.run.smithi005.stderr:zip_safe flag not set; analyzing archive contents... 2019-11-27T13:01:17.694 INFO:teuthology.orchestra.run.smithi005.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T13:01:17.696 INFO:teuthology.orchestra.run.smithi005.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-27T13:01:17.698 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.698 INFO:teuthology.orchestra.run.smithi005.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-11-27T13:01:17.738 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for gevent==1.4.0 2019-11-27T13:01:17.738 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: gevent 1.4.0 2019-11-27T13:01:17.738 INFO:teuthology.orchestra.run.smithi005.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-27T13:01:17.739 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.739 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T13:01:17.740 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for bunch==1.0.1 2019-11-27T13:01:17.740 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: bunch 1.0.1 2019-11-27T13:01:17.740 INFO:teuthology.orchestra.run.smithi005.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-27T13:01:17.740 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.741 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T13:01:17.741 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for PyYAML==5.1.2 2019-11-27T13:01:17.741 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: PyYAML 5.1.2 2019-11-27T13:01:17.742 INFO:teuthology.orchestra.run.smithi005.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-27T13:01:17.742 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.742 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T13:01:17.743 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for boto==2.49.0 2019-11-27T13:01:17.743 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: boto 2.49.0 2019-11-27T13:01:17.743 INFO:teuthology.orchestra.run.smithi005.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-27T13:01:17.743 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.743 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T13:01:17.744 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for six==1.9.0 2019-11-27T13:01:17.744 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: six 1.9.0 2019-11-27T13:01:17.744 INFO:teuthology.orchestra.run.smithi005.stdout:Adding six 1.9.0 to easy-install.pth file 2019-11-27T13:01:17.745 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.745 INFO:teuthology.orchestra.run.smithi005.stdout:Using /usr/lib/python2.7/site-packages 2019-11-27T13:01:17.755 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for greenlet==0.4.15 2019-11-27T13:01:17.755 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: greenlet 0.4.15 2019-11-27T13:01:17.755 INFO:teuthology.orchestra.run.smithi005.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-27T13:01:17.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:01:17.755 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T13:01:17.756 INFO:teuthology.orchestra.run.smithi005.stdout:Finished processing dependencies for ragweed==0.0.1 2019-11-27T13:01:17.771 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-11-27T13:01:17.833 INFO:tasks.ragweed:Configuring boto... 2019-11-27T13:01:17.833 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-27T13:01:17.964 INFO:teuthology.orchestra.run.smithi005:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-11-27T13:01:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-11-27T13:02:08.724 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-11-27T13:02:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-11-27T13:02:59.006 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-11-27T13:03:28.198 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:02.322 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.275 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:02.398 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.289 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:09:02.310 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.293 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:02.416 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.334 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:02.458 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.376 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:09:02.397 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.959 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:03.083 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:28.993 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:03.116 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:03:29.114 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-11-27T13:03:29.141 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:09:03.162 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:04:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-11-27T13:05:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-11-27T13:05:39.647 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:13.761 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.666 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:11:13.689 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.667 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:13.781 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.674 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:11:13.697 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.680 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:13.795 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.688 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:13.802 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.804 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:11:13.827 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.858 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:13.972 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:05:39.874 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:13.988 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:07:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-11-27T13:08:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-11-27T13:08:02.355 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T13:08:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:---------------------------------------------------------------------- 2019-11-27T13:08:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:Ran 9 tests in 403.756s 2019-11-27T13:08:02.355 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T13:08:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:OK 2019-11-27T13:08:02.391 INFO:tasks.ragweed:Cleaning up boto... 2019-11-27T13:08:02.391 INFO:teuthology.orchestra.run.smithi005:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-27T13:08:02.452 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-11-27T13:08:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.527+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.557+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.558+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.565+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.565+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.575+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.575+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.589+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.762+0000 7f17aa076ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:08:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.762+0000 7f17aa076ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:08:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.762+0000 7f17aa076ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:08:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.762+0000 7f17aa076ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:08:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.762+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.777+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.777+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.788+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.788+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.799+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.799+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.811+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:02.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.811+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.818+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.818+0000 7f17aa076ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:08:02.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.818+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.899 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.831+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.831+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.849+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.849+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.867+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.867+0000 7f17aa076ec0 20 zonegroup default 2019-11-27T13:08:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.867+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.879+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.879+0000 7f17aa076ec0 10 Cannot find current period zone using local zone 2019-11-27T13:08:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.879+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.959 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.890+0000 7f17aa076ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:02.959 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.890+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.908+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.908+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.925+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.925+0000 7f17aa076ec0 20 zone default found 2019-11-27T13:08:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.925+0000 7f17aa076ec0 20 started sync module instance, tier type = 2019-11-27T13:08:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:02.925+0000 7f17aa076ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:08:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.189+0000 7f17972a3700 0 -- 172.21.15.5:0/2253510337 >> [v2:172.21.15.5:6818/10045,v1:172.21.15.5:6819/10045] conn(0x7f1790009000 msgr2=0x7f17900062a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:03.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=0 2019-11-27T13:08:03.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=1 2019-11-27T13:08:03.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=2 2019-11-27T13:08:03.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=3 2019-11-27T13:08:03.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=4 2019-11-27T13:08:03.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=5 2019-11-27T13:08:03.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.241+0000 7f17aa076ec0 20 add_watcher() i=6 2019-11-27T13:08:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.276+0000 7f17aa076ec0 20 add_watcher() i=7 2019-11-27T13:08:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.276+0000 7f17aa076ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:08:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.277+0000 7f1767fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:08:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:03.293+0000 7f17972a3700 0 -- 172.21.15.5:0/3663675964 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55a4dbf2ffd0 msgr2=0x55a4dbf323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.160+0000 7f16d67fc700 20 reqs_thread_entry: start 2019-11-27T13:08:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.160+0000 7f16cffff700 20 reqs_thread_entry: start 2019-11-27T13:08:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.160+0000 7f17aa076ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.161+0000 7f16ce7fc700 20 reqs_thread_entry: start 2019-11-27T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.161+0000 7f17aa076ec0 20 get_system_obj_state: rctx=0x7ffda3945f48 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55a4dbfa7400 s->prefetch_data=0 2019-11-27T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.161+0000 7f17aa076ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-27T13:08:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.179+0000 7f17aa076ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-11-27T13:08:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.179+0000 7f17aa076ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T13:08:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.179+0000 7f17aa076ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.179+0000 7f17aa076ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.179+0000 7f17aa076ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T13:08:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.179+0000 7f17aa076ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.199+0000 7f17aa076ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-27T13:08:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.199+0000 7f17aa076ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-11-27T13:08:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.199+0000 7f17aa076ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T13:08:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.207+0000 7f17aa076ec0 10 removing key index: ICXTOYVNYTQDYKNIGOWF 2019-11-27T13:08:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.207+0000 7f17aa076ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2019-11-27T13:08:05.290 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.223+0000 7f178cff9700 10 RGWWatcher::handle_notify() notify_id 579820584965 cookie 94166553032880 notifier 4457 bl.length()=170 2019-11-27T13:08:05.471 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.404+0000 7f17aa076ec0 10 removing email index: sysuser.client.0+test@test.test 2019-11-27T13:08:05.472 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.404+0000 7f17aa076ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-11-27T13:08:05.482 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.415+0000 7f178cff9700 10 RGWWatcher::handle_notify() notify_id 579820584966 cookie 94166553032880 notifier 4457 bl.length()=182 2019-11-27T13:08:05.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.875+0000 7f17aa076ec0 10 removing user buckets index 2019-11-27T13:08:05.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.875+0000 7f17aa076ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-11-27T13:08:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:05.925+0000 7f178cff9700 10 RGWWatcher::handle_notify() notify_id 579820584960 cookie 94166553030544 notifier 4457 bl.length()=173 2019-11-27T13:08:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.390+0000 7f17aa076ec0 10 removing user index: sysuser.client.0 2019-11-27T13:08:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.390+0000 7f17aa076ec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-11-27T13:08:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.390+0000 7f17aa076ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-11-27T13:08:06.499 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.431+0000 7f178cff9700 10 RGWWatcher::handle_notify() notify_id 579820584967 cookie 94166553029008 notifier 4457 bl.length()=165 2019-11-27T13:08:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.685+0000 7f17aa076ec0 20 remove_watcher() i=0 2019-11-27T13:08:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.685+0000 7f17aa076ec0 2 removed watcher, disabling cache 2019-11-27T13:08:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.733+0000 7f17aa076ec0 20 remove_watcher() i=1 2019-11-27T13:08:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.768+0000 7f17aa076ec0 20 remove_watcher() i=2 2019-11-27T13:08:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.816+0000 7f17aa076ec0 20 remove_watcher() i=3 2019-11-27T13:08:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.851+0000 7f17aa076ec0 20 remove_watcher() i=4 2019-11-27T13:08:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.897+0000 7f17aa076ec0 20 remove_watcher() i=5 2019-11-27T13:08:07.016 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.948+0000 7f17aa076ec0 20 remove_watcher() i=6 2019-11-27T13:08:07.063 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:06.996+0000 7f17aa076ec0 20 remove_watcher() i=7 2019-11-27T13:08:07.073 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-11-27T13:08:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.134+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.231 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.164+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.231 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.164+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.174+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.174+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.182+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.183+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.203+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.437+0000 7f691b60eec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:08:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.437+0000 7f691b60eec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:08:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.437+0000 7f691b60eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:08:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.437+0000 7f691b60eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:08:07.506 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.437+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.451+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.451+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.464+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.464+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.474+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.474+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.486+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.486+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.498+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.498+0000 7f691b60eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:08:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.499+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.506+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.506+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.520+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.521+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.531+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:07.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.531+0000 7f691b60eec0 20 zonegroup default 2019-11-27T13:08:07.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.531+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.540+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.540+0000 7f691b60eec0 10 Cannot find current period zone using local zone 2019-11-27T13:08:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.540+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.548+0000 7f691b60eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.548+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.557+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.557+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.572+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.572+0000 7f691b60eec0 20 zone default found 2019-11-27T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.572+0000 7f691b60eec0 20 started sync module instance, tier type = 2019-11-27T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.572+0000 7f691b60eec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:08:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=0 2019-11-27T13:08:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=1 2019-11-27T13:08:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=2 2019-11-27T13:08:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=3 2019-11-27T13:08:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=4 2019-11-27T13:08:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=5 2019-11-27T13:08:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.952+0000 7f691b60eec0 20 add_watcher() i=6 2019-11-27T13:08:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.993+0000 7f691b60eec0 20 add_watcher() i=7 2019-11-27T13:08:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.993+0000 7f691b60eec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:08:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:07.993+0000 7f68d97e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:08:08.081 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:08.012+0000 7f690883b700 0 -- 172.21.15.5:0/679648685 >> v1:172.21.15.115:6789/0 conn(0x55c33363d6b0 legacy=0x55c33363fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:08.187+0000 7f690883b700 0 -- 172.21.15.5:0/679648685 >> [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] conn(0x55c333652450 msgr2=0x55c333654960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.601+0000 7f684b7fe700 20 reqs_thread_entry: start 2019-11-27T13:08:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.601+0000 7f68497fa700 20 reqs_thread_entry: start 2019-11-27T13:08:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.601+0000 7f691b60eec0 20 init_complete bucket index max shards: 0 2019-11-27T13:08:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.602+0000 7f68377fe700 20 reqs_thread_entry: start 2019-11-27T13:08:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.602+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc2d8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55c3336b5c50 s->prefetch_data=0 2019-11-27T13:08:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.602+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-27T13:08:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.616+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-11-27T13:08:09.685 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.616+0000 7f691b60eec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T13:08:09.685 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.616+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:09.685 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.616+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:09.685 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.616+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T13:08:09.685 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.616+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:09.711 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.643+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-27T13:08:09.711 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.643+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-11-27T13:08:09.711 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.643+0000 7f691b60eec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T13:08:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.689+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-conf state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.689+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-11-27T13:08:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.710+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-11-27T13:08:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.710+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-27T13:08:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.710+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.710+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.710+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.710+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.726+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=200 2019-11-27T13:08:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.726+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-11-27T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.726+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-27T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.726+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 state=0x55c3336b9b30 s->prefetch_data=0 2019-11-27T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.726+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 : miss 2019-11-27T13:08:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 info.flags=0x16 2019-11-27T13:08:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 to cache LRU end 2019-11-27T13:08:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.754+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.787+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=292 2019-11-27T13:08:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.787+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 info.flags=0x13 2019-11-27T13:08:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.787+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 to cache LRU end 2019-11-27T13:08:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.787+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.787+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.787+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:09.897 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.828+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-conf[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1]) start [] num_entries 1100 2019-11-27T13:08:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-11-27T13:08:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-11-27T13:08:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-11-27T13:08:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:09.904+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.014+0000 7f691b60eec0 10 manifest: total_size = 5942 2019-11-27T13:08:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.014+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.13 2019-11-27T13:08:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.014+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.014+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf178 2019-11-27T13:08:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.014+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.184+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.327+0000 7f691b60eec0 10 manifest: total_size = 3916 2019-11-27T13:08:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.327+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.30 2019-11-27T13:08:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.327+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.327+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf2d8 2019-11-27T13:08:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.327+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.487+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.609+0000 7f691b60eec0 10 manifest: total_size = 9698 2019-11-27T13:08:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.609+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.56 2019-11-27T13:08:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.609+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.609+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf2d8 2019-11-27T13:08:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.609+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.755+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.783+0000 7f691b60eec0 10 manifest: total_size = 5808 2019-11-27T13:08:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.783+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.72 2019-11-27T13:08:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.783+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.783+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf2d8 2019-11-27T13:08:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:10.783+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:11.086 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.017+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:11.130 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.061+0000 7f691b60eec0 10 manifest: total_size = 3927 2019-11-27T13:08:11.130 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.061+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.87 2019-11-27T13:08:11.130 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.061+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c3336bf2d8 s->prefetch_data=0 2019-11-27T13:08:11.130 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.061+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf2d8 2019-11-27T13:08:11.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.061+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.294+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.327+0000 7f691b60eec0 10 manifest: total_size = 12913 2019-11-27T13:08:11.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.327+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.120 2019-11-27T13:08:11.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.327+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.327+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf178 2019-11-27T13:08:11.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.327+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.474+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.495+0000 7f691b60eec0 10 manifest: total_size = 4074 2019-11-27T13:08:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.495+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.189 2019-11-27T13:08:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.495+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.495+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf178 2019-11-27T13:08:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.495+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.659+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.700+0000 7f691b60eec0 10 manifest: total_size = 6095 2019-11-27T13:08:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.700+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.246 2019-11-27T13:08:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.700+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.700+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf178 2019-11-27T13:08:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.700+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:11.963 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.894+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.927+0000 7f691b60eec0 10 manifest: total_size = 6761 2019-11-27T13:08:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.927+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.322 2019-11-27T13:08:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.927+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c3336bf178 s->prefetch_data=0 2019-11-27T13:08:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.927+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf178 2019-11-27T13:08:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:11.927+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 2019-11-27T13:08:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.178+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-conf[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1]) start _multipart_[] num_entries 1001 2019-11-27T13:08:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.178+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.335+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.461+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-conf state=0x55c3336bff80 s->prefetch_data=0 2019-11-27T13:08:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.461+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-11-27T13:08:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-27T13:08:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-11-27T13:08:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.478+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-11-27T13:08:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.492+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94296869054400 notifier 4472 bl.length()=162 2019-11-27T13:08:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.798+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.1 from cache 2019-11-27T13:08:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.798+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=219 2019-11-27T13:08:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:12.810+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94296869062224 notifier 4472 bl.length()=219 2019-11-27T13:08:13.274 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.204+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55c3336be500 s->prefetch_data=0 2019-11-27T13:08:13.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.204+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-11-27T13:08:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.217+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-11-27T13:08:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.217+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-27T13:08:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.217+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.217+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.217+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.217+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.230+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=229 2019-11-27T13:08:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.230+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-11-27T13:08:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.230+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-27T13:08:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.230+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.230+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 : miss 2019-11-27T13:08:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 info.flags=0x16 2019-11-27T13:08:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 to cache LRU end 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.252+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.278+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=321 2019-11-27T13:08:13.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.278+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 info.flags=0x13 2019-11-27T13:08:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.278+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 to cache LRU end 2019-11-27T13:08:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.278+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.278+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.278+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 2019-11-27T13:08:13.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.313+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2]) start [] num_entries 1100 2019-11-27T13:08:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.377+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-27T13:08:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.377+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c3336bf4e8 s->prefetch_data=0 2019-11-27T13:08:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.400+0000 7f691b60eec0 10 manifest: total_size = 74198 2019-11-27T13:08:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.400+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.20 2019-11-27T13:08:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.400+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c3336bf4e8 s->prefetch_data=0 2019-11-27T13:08:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.400+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336bf4e8 2019-11-27T13:08:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.400+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-11-27T13:08:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T13:08:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-11-27T13:08:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-11-27T13:08:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-11-27T13:08:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-11-27T13:08:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-11-27T13:08:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.567+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.20 2019-11-27T13:08:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.695+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2]) start _multipart_[] num_entries 1001 2019-11-27T13:08:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.695+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:13.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.726+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.870+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55c3336bced0 s->prefetch_data=0 2019-11-27T13:08:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.870+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-11-27T13:08:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-27T13:08:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-11-27T13:08:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.896+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-11-27T13:08:13.986 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:13.918+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94296869057712 notifier 4472 bl.length()=191 2019-11-27T13:08:14.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:14.545+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2 from cache 2019-11-27T13:08:14.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:14.545+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=248 2019-11-27T13:08:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:14.573+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584960 cookie 94296869070112 notifier 4472 bl.length()=248 2019-11-27T13:08:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.011+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55c3336b9ac0 s->prefetch_data=0 2019-11-27T13:08:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.011+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-11-27T13:08:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.034+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-11-27T13:08:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.034+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-27T13:08:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.034+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.034+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.034+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.034+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.046+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=236 2019-11-27T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.046+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-11-27T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.046+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-27T13:08:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.046+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.046+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 : miss 2019-11-27T13:08:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 info.flags=0x16 2019-11-27T13:08:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 to cache LRU end 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.073+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.101+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=328 2019-11-27T13:08:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.101+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 info.flags=0x13 2019-11-27T13:08:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.101+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 to cache LRU end 2019-11-27T13:08:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.101+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.101+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.101+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 2019-11-27T13:08:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.165+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3]) start [] num_entries 1100 2019-11-27T13:08:15.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.225+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-27T13:08:15.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.225+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.246+0000 7f691b60eec0 10 manifest: total_size = 74198 2019-11-27T13:08:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.246+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.40 2019-11-27T13:08:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.246+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.246+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.246+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 2019-11-27T13:08:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T13:08:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-11-27T13:08:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-11-27T13:08:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-11-27T13:08:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-11-27T13:08:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-11-27T13:08:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.347+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.40 2019-11-27T13:08:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.462+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3]) start _multipart_[] num_entries 1001 2019-11-27T13:08:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.462+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:15.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.491+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.604+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.604+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-11-27T13:08:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-27T13:08:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-11-27T13:08:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.631+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-11-27T13:08:15.718 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:15.650+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584968 cookie 94296869060656 notifier 4472 bl.length()=198 2019-11-27T13:08:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.670+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3 from cache 2019-11-27T13:08:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.670+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=255 2019-11-27T13:08:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.686+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94296869068192 notifier 4472 bl.length()=255 2019-11-27T13:08:17.011 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.943+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55c3336b9ac0 s->prefetch_data=0 2019-11-27T13:08:17.011 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.943+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-11-27T13:08:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.954+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-11-27T13:08:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.954+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-27T13:08:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.954+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.954+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.954+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.954+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.967+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=231 2019-11-27T13:08:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.967+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-11-27T13:08:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.967+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-27T13:08:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.967+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.967+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 : miss 2019-11-27T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 info.flags=0x16 2019-11-27T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 to cache LRU end 2019-11-27T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:16.984+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.005+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=323 2019-11-27T13:08:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.005+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 info.flags=0x13 2019-11-27T13:08:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.005+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 to cache LRU end 2019-11-27T13:08:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.005+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.005+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.005+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.136 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.068+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4]) start [] num_entries 1100 2019-11-27T13:08:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.161+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo[W.CJkXq2EHbONJ.EtiO9MLLBFnT36Wx] 2019-11-27T13:08:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.161+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.268 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.199+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55c33360c6f8 s->prefetch_data=0 2019-11-27T13:08:17.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.213+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to 1bryshjtezlokptvyq9us8z87s0a42f5 2019-11-27T13:08:17.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.213+0000 7f691b60eec0 20 get_obj_state_impl: setting s->olh_tag to yazkb7tnh1zlq19axfcr08skg01dtykz 2019-11-27T13:08:17.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.213+0000 7f691b60eec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yazkb7tnh1zlq19axfcr08skg01dtykz 2019-11-27T13:08:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.256+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.393+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.393+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.435+0000 7f691b60eec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-11-27T13:08:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.435+0000 7f691b60eec0 20 olh_log_entry: epoch=3 op=3 key=foo[W.CJkXq2EHbONJ.EtiO9MLLBFnT36Wx] 2019-11-27T13:08:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.435+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:W.CJkXq2EHbONJ.EtiO9MLLBFnT36Wx_foo state=0x55c3336c7a78 s->prefetch_data=0 2019-11-27T13:08:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.486+0000 7f691b60eec0 10 manifest: total_size = 886297 2019-11-27T13:08:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.486+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.55 2019-11-27T13:08:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.486+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:W.CJkXq2EHbONJ.EtiO9MLLBFnT36Wx_foo state=0x55c3336c7a78 s->prefetch_data=0 2019-11-27T13:08:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.486+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c7a78 2019-11-27T13:08:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.486+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-27T13:08:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-27T13:08:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-27T13:08:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-27T13:08:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-27T13:08:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-11-27T13:08:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.664+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.55 2019-11-27T13:08:17.897 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.828+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:17.897 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.828+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:18.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:17.958+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.061+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 2019-11-27T13:08:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.061+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4]) start _multipart_[] num_entries 1001 2019-11-27T13:08:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.061+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:18.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.090+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.204+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55c333605d20 s->prefetch_data=0 2019-11-27T13:08:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.204+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:18.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-11-27T13:08:18.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-27T13:08:18.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:18.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:18.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:18.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-11-27T13:08:18.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.233+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-11-27T13:08:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.247+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584969 cookie 94296869060656 notifier 4472 bl.length()=193 2019-11-27T13:08:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.482+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4 from cache 2019-11-27T13:08:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.482+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=250 2019-11-27T13:08:18.565 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.496+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94296869072880 notifier 4472 bl.length()=250 2019-11-27T13:08:18.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.831+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55c333605d20 s->prefetch_data=0 2019-11-27T13:08:18.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.831+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-11-27T13:08:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.850+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-11-27T13:08:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.850+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-27T13:08:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.850+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.850+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.850+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.850+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:18.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.863+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T13:08:18.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.863+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-11-27T13:08:18.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.863+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-27T13:08:18.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.863+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:18.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.863+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 : miss 2019-11-27T13:08:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 info.flags=0x16 2019-11-27T13:08:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 to cache LRU end 2019-11-27T13:08:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.880+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.903+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T13:08:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.903+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 info.flags=0x13 2019-11-27T13:08:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.903+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 to cache LRU end 2019-11-27T13:08:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.903+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.903+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.904+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 2019-11-27T13:08:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.927+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5]) start [] num_entries 1100 2019-11-27T13:08:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.961+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-27T13:08:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.961+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.972+0000 7f691b60eec0 10 manifest: total_size = 26082 2019-11-27T13:08:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.972+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.71 2019-11-27T13:08:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.972+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.972+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:18.972+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 2019-11-27T13:08:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2019-11-27T13:08:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2019-11-27T13:08:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7673 2019-11-27T13:08:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2019-11-27T13:08:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7673 2019-11-27T13:08:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7672 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4209647 part_ofs=15343 rule->part_size=7672 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4217319 part_ofs=23015 rule->part_size=3067 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2019-11-27T13:08:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.094+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.71 2019-11-27T13:08:19.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.217+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5]) start _multipart_[] num_entries 1001 2019-11-27T13:08:19.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.217+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.253+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:19.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.338+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:19.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.338+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-11-27T13:08:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-27T13:08:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-11-27T13:08:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.350+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-11-27T13:08:19.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.364+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584970 cookie 94296869065424 notifier 4472 bl.length()=183 2019-11-27T13:08:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.686+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5 from cache 2019-11-27T13:08:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.686+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=240 2019-11-27T13:08:19.778 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:19.709+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584963 cookie 94296869057712 notifier 4472 bl.length()=240 2019-11-27T13:08:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.141+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55c3336b7570 s->prefetch_data=0 2019-11-27T13:08:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.141+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-11-27T13:08:20.227 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.156+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-11-27T13:08:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.156+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-27T13:08:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.156+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.156+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.156+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.156+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.169+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=227 2019-11-27T13:08:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.169+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-11-27T13:08:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.169+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-27T13:08:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.169+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 state=0x55c333605d20 s->prefetch_data=0 2019-11-27T13:08:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.169+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 : miss 2019-11-27T13:08:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 info.flags=0x16 2019-11-27T13:08:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 to cache LRU end 2019-11-27T13:08:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.190+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.213+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=319 2019-11-27T13:08:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.213+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 info.flags=0x13 2019-11-27T13:08:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.213+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 to cache LRU end 2019-11-27T13:08:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.213+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.213+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.213+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.263+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7]) start [] num_entries 1100 2019-11-27T13:08:20.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T13:08:20.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-27T13:08:20.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-27T13:08:20.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-27T13:08:20.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-27T13:08:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-27T13:08:20.434 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.362+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:20.469 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.400+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:20.469 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.400+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.108 2019-11-27T13:08:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.400+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.400+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.400+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.569+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.569+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.569+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.569+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.569+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.108 2019-11-27T13:08:20.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.644+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.675+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.676+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.109 2019-11-27T13:08:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.676+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.676+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.676+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.804+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.804+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.804+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.804+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.804+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.109 2019-11-27T13:08:20.930 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.860+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.891+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.891+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _8mUHklBPnjz_T2Kfghq3HqkwkseVZ5r 2019-11-27T13:08:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.891+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.891+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:20.891+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.034+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.034+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.034+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.034+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.034+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _8mUHklBPnjz_T2Kfghq3HqkwkseVZ5r 2019-11-27T13:08:21.157 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.087+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.115+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.115+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _zFdKcica9GwoCyodSOR6XYXHjE3f0rr 2019-11-27T13:08:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.115+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.115+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.115+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.253+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.253+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.253+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _zFdKcica9GwoCyodSOR6XYXHjE3f0rr 2019-11-27T13:08:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.302+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.333+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:21.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.333+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.112 2019-11-27T13:08:21.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.333+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.403 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.333+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:21.403 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.333+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.430+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.430+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.430+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.430+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.430+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.112 2019-11-27T13:08:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.493+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.520+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.520+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _XSNad04MQg590_co3r7YWz-fpxm0LsQ 2019-11-27T13:08:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.520+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.520+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.520+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.677+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.677+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.677+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.677+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.677+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _XSNad04MQg590_co3r7YWz-fpxm0LsQ 2019-11-27T13:08:21.822 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.753+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.791+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.791+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.114 2019-11-27T13:08:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.791+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.791+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.791+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:21.971 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.901+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.971 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.901+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.971 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.901+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:21.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.901+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:21.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.901+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.114 2019-11-27T13:08:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:21.970+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.003+0000 7f691b60eec0 10 manifest: total_size = 5242880 2019-11-27T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.003+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _TGGGEKuXB5dTa43WSmUIEt46nPkzHaO 2019-11-27T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.003+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.003+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.003+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.206+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.206+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T13:08:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.206+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _TGGGEKuXB5dTa43WSmUIEt46nPkzHaO 2019-11-27T13:08:22.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.278+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.300+0000 7f691b60eec0 10 manifest: total_size = 22651 2019-11-27T13:08:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.300+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.116 2019-11-27T13:08:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.300+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.300+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:22.371 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.300+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.476+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.502+0000 7f691b60eec0 10 manifest: total_size = 22651 2019-11-27T13:08:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.502+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _-46k9KmEpBchVCyHnvYO3mGvMFskHvC 2019-11-27T13:08:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.502+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.502+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.502+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:22.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.720+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:22.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.720+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2019-11-27T13:08:22.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.720+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _-46k9KmEpBchVCyHnvYO3mGvMFskHvC 2019-11-27T13:08:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.773+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.796+0000 7f691b60eec0 10 manifest: total_size = 22651 2019-11-27T13:08:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.796+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _TEC9ubkjbSuqoHsty00yJTw8ArqUTnk 2019-11-27T13:08:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.796+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.796+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.796+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.895+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.895+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2019-11-27T13:08:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:22.895+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _TEC9ubkjbSuqoHsty00yJTw8ArqUTnk 2019-11-27T13:08:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.045+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.086+0000 7f691b60eec0 10 manifest: total_size = 22651 2019-11-27T13:08:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.086+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _FYm5mTENr2mk3tWIjyF9ol4e-GTNd_t 2019-11-27T13:08:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.086+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.086+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.086+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 2019-11-27T13:08:23.296 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.227+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7]) start _multipart_[] num_entries 1001 2019-11-27T13:08:23.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.227+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.364+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:23.524 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.454+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:23.524 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.454+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-11-27T13:08:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-27T13:08:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-11-27T13:08:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.476+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-11-27T13:08:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:23.496+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584971 cookie 94296869060656 notifier 4472 bl.length()=189 2019-11-27T13:08:24.075 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.006+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7 from cache 2019-11-27T13:08:24.076 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.006+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=246 2019-11-27T13:08:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.020+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584963 cookie 94296869072880 notifier 4472 bl.length()=246 2019-11-27T13:08:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.734+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55c333605d20 s->prefetch_data=0 2019-11-27T13:08:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.734+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-11-27T13:08:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.750+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-11-27T13:08:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.750+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-27T13:08:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.750+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.750+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.750+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.750+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.759+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=237 2019-11-27T13:08:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.759+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-11-27T13:08:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.759+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-27T13:08:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.759+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.759+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 : miss 2019-11-27T13:08:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 info.flags=0x16 2019-11-27T13:08:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 to cache LRU end 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.771+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.798+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=329 2019-11-27T13:08:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.798+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 info.flags=0x13 2019-11-27T13:08:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.798+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 to cache LRU end 2019-11-27T13:08:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.798+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.798+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.798+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.829+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9]) start [] num_entries 1100 2019-11-27T13:08:24.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T13:08:24.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-27T13:08:24.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-27T13:08:24.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-27T13:08:24.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T13:08:24.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-27T13:08:24.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-27T13:08:24.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-27T13:08:24.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T13:08:24.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-27T13:08:24.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-27T13:08:24.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-27T13:08:24.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.866+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.877+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.877+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.224 2019-11-27T13:08:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.877+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.877+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:24.877+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.008+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.008+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.008+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.009+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.224 2019-11-27T13:08:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.047+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.060+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.060+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.225 2019-11-27T13:08:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.060+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.060+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.060+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.174+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.225 2019-11-27T13:08:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.253+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.266+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:25.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.266+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _KZB5AJfYxqIpJesGLlCu18POHXBZKh9 2019-11-27T13:08:25.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.266+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.266+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:25.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.266+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T13:08:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T13:08:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.368+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _KZB5AJfYxqIpJesGLlCu18POHXBZKh9 2019-11-27T13:08:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.417+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.435+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.435+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _nW2HrjNZdeSWkuCFLxmFNgq2jdf71ld 2019-11-27T13:08:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.435+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.435+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.435+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.558+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.558+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T13:08:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.558+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.558+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T13:08:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.558+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _nW2HrjNZdeSWkuCFLxmFNgq2jdf71ld 2019-11-27T13:08:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.639+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.655+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.655+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.233 2019-11-27T13:08:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.655+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.655+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.655+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.781+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.233 2019-11-27T13:08:25.914 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.845+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.862+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.862+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _j_2LBpdULoXoGEgc5Kcvo6vhg1VBMv1 2019-11-27T13:08:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.862+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.862+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:25.862+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T13:08:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T13:08:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.018+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _j_2LBpdULoXoGEgc5Kcvo6vhg1VBMv1 2019-11-27T13:08:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.075+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.086+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.086+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.235 2019-11-27T13:08:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.086+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.086+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.086+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.237+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.235 2019-11-27T13:08:26.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.279+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.291+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.291+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _TnZJymLrwdY7_qU9gYf4qf5w3bOQffC 2019-11-27T13:08:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.291+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.291+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:26.361 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.291+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.419+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.419+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T13:08:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.419+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.419+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T13:08:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.419+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _TnZJymLrwdY7_qU9gYf4qf5w3bOQffC 2019-11-27T13:08:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.473+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.486+0000 7f691b60eec0 10 manifest: total_size = 16377 2019-11-27T13:08:26.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.486+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.242 2019-11-27T13:08:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.486+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.486+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.486+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2019-11-27T13:08:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2019-11-27T13:08:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7671 2019-11-27T13:08:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2019-11-27T13:08:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7671 2019-11-27T13:08:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2019-11-27T13:08:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2019-11-27T13:08:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=1035 2019-11-27T13:08:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2019-11-27T13:08:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.614+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.242 2019-11-27T13:08:26.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.674+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.710+0000 7f691b60eec0 10 manifest: total_size = 16377 2019-11-27T13:08:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.710+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _6Gw-jNq4o28aDHXsnTxo_bO6u5itpSI 2019-11-27T13:08:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.710+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.710+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.710+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.813+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.813+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2019-11-27T13:08:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.813+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _6Gw-jNq4o28aDHXsnTxo_bO6u5itpSI 2019-11-27T13:08:26.926 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.857+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.960 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.891+0000 7f691b60eec0 10 manifest: total_size = 16377 2019-11-27T13:08:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.891+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to _5Y6N5QjXqR19gophsIFGHP1OPoWrw-9 2019-11-27T13:08:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.891+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.891+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:26.891+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.021+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.021+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2019-11-27T13:08:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.021+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _5Y6N5QjXqR19gophsIFGHP1OPoWrw-9 2019-11-27T13:08:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.078+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.103+0000 7f691b60eec0 10 manifest: total_size = 16377 2019-11-27T13:08:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.103+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.245 2019-11-27T13:08:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.103+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.103+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.103+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 2019-11-27T13:08:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2019-11-27T13:08:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7671 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7671 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=1035 2019-11-27T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2019-11-27T13:08:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.248+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.245 2019-11-27T13:08:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.312+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9]) start _multipart_[] num_entries 1001 2019-11-27T13:08:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.312+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.335+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.419+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.419+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:27.500 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-11-27T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-27T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-11-27T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.431+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-11-27T13:08:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.441+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94296869062224 notifier 4472 bl.length()=199 2019-11-27T13:08:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.692+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9 from cache 2019-11-27T13:08:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.692+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=256 2019-11-27T13:08:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:27.700+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584964 cookie 94296869054400 notifier 4472 bl.length()=256 2019-11-27T13:08:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.207+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.207+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-11-27T13:08:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.222+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-11-27T13:08:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.222+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-27T13:08:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.222+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.222+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.222+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.222+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.240+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=232 2019-11-27T13:08:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.240+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-11-27T13:08:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.240+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-27T13:08:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.240+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 state=0x55c3336c4320 s->prefetch_data=0 2019-11-27T13:08:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.240+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 : miss 2019-11-27T13:08:28.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 info.flags=0x16 2019-11-27T13:08:28.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 to cache LRU end 2019-11-27T13:08:28.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:28.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:28.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:28.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.263+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.286+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=324 2019-11-27T13:08:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.286+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 info.flags=0x13 2019-11-27T13:08:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.286+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 to cache LRU end 2019-11-27T13:08:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.286+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.286+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.286+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 2019-11-27T13:08:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.316+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8]) start [] num_entries 1100 2019-11-27T13:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.375+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T13:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.375+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T13:08:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.375+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T13:08:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.375+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:28.456 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.387+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:28.456 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.387+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.196 2019-11-27T13:08:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.387+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.387+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.387+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.536+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.537+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.196 2019-11-27T13:08:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.603+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.622+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.622+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.203 2019-11-27T13:08:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.622+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.622+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.622+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 2019-11-27T13:08:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.726+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.203 2019-11-27T13:08:28.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.796+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.813+0000 7f691b60eec0 10 manifest: total_size = 11534336 2019-11-27T13:08:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.813+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.210 2019-11-27T13:08:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.813+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.813+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.813+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 2019-11-27T13:08:29.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:29.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:29.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T13:08:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T13:08:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:28.966+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.210 2019-11-27T13:08:29.095 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.024+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8]) start _multipart_[] num_entries 1001 2019-11-27T13:08:29.095 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.024+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.072+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.228+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.228+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-11-27T13:08:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-27T13:08:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-11-27T13:08:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.253+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-11-27T13:08:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.270+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584964 cookie 94296869068192 notifier 4472 bl.length()=194 2019-11-27T13:08:29.580 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.510+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8 from cache 2019-11-27T13:08:29.580 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.510+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=251 2019-11-27T13:08:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.528+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584965 cookie 94296869054400 notifier 4472 bl.length()=251 2019-11-27T13:08:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.833+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.833+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-11-27T13:08:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.853+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-11-27T13:08:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.853+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-27T13:08:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.853+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.853+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.853+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.853+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.870+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=222 2019-11-27T13:08:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.871+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-11-27T13:08:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.871+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-27T13:08:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.871+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 state=0x55c3336c4320 s->prefetch_data=0 2019-11-27T13:08:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.871+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 : miss 2019-11-27T13:08:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 info.flags=0x16 2019-11-27T13:08:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 to cache LRU end 2019-11-27T13:08:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.942+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.969+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=314 2019-11-27T13:08:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.969+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 info.flags=0x13 2019-11-27T13:08:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.969+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 to cache LRU end 2019-11-27T13:08:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.969+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.969+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.969+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 2019-11-27T13:08:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:29.994+0000 7f68d97e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:08:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.014+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6]) start [] num_entries 1100 2019-11-27T13:08:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.081+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T13:08:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.081+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T13:08:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.081+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T13:08:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.081+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.107+0000 7f691b60eec0 10 manifest: total_size = 10485760 2019-11-27T13:08:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.107+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.84 2019-11-27T13:08:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.107+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.107+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.107+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 2019-11-27T13:08:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T13:08:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-27T13:08:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.287+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.84 2019-11-27T13:08:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.432+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:30.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.462+0000 7f691b60eec0 10 manifest: total_size = 10485760 2019-11-27T13:08:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.462+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.85 2019-11-27T13:08:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.462+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.462+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:30.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.462+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 2019-11-27T13:08:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T13:08:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T13:08:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T13:08:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-27T13:08:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.621+0000 7f691b60eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.85 2019-11-27T13:08:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.679+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.726+0000 7f691b60eec0 10 manifest: total_size = 648332 2019-11-27T13:08:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.726+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.86 2019-11-27T13:08:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.726+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.726+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:30.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.726+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 2019-11-27T13:08:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.866+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6]) start _multipart_[] num_entries 1001 2019-11-27T13:08:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.866+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:30.984+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.101+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.101+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-11-27T13:08:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-27T13:08:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-11-27T13:08:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.113+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-11-27T13:08:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.123+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584972 cookie 94296869060656 notifier 4472 bl.length()=184 2019-11-27T13:08:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.344+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6 from cache 2019-11-27T13:08:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.344+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=241 2019-11-27T13:08:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:31.365+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584965 cookie 94296869068192 notifier 4472 bl.length()=241 2019-11-27T13:08:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.333+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55c3336c4320 s->prefetch_data=0 2019-11-27T13:08:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.333+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-11-27T13:08:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.351+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-11-27T13:08:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.351+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-27T13:08:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.351+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.351+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.351+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.351+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.362+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T13:08:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.362+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-11-27T13:08:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.362+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-27T13:08:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.362+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.362+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 : miss 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.383+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 info.flags=0x16 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 to cache LRU end 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.384+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.416+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.416+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 info.flags=0x13 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.416+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 to cache LRU end 2019-11-27T13:08:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.416+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.416+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.416+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.448+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10]) start [] num_entries 1100 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.526+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.526+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.526+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.526+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-27T13:08:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.526+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.569+0000 7f691b60eec0 10 manifest: total_size = 1035 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.569+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.305 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.569+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.569+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.569+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.736+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.768+0000 7f691b60eec0 10 manifest: total_size = 49187 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.768+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.307 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.768+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.768+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:32.768+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.011+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.032+0000 7f691b60eec0 10 manifest: total_size = 4134 2019-11-27T13:08:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.032+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.306 2019-11-27T13:08:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.032+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.032+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.032+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 2019-11-27T13:08:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.296+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.336+0000 7f691b60eec0 10 manifest: total_size = 49187 2019-11-27T13:08:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.337+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.304 2019-11-27T13:08:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.337+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.337+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.337+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 2019-11-27T13:08:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.517+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10]) start _multipart_[] num_entries 1001 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.517+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.686+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.831+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55c3336c4320 s->prefetch_data=0 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.831+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-27T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.855+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:33.879+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584966 cookie 94296869057712 notifier 4472 bl.length()=181 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.383+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.10 from cache 2019-11-27T13:08:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.383+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.402+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584963 cookie 94296869062224 notifier 4472 bl.length()=239 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.913+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.913+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.935+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.935+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.935+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.935+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.935+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.935+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.948+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.948+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.948+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.948+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 state=0x55c3336c4320 s->prefetch_data=0 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.948+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 : miss 2019-11-27T13:08:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 info.flags=0x16 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 to cache LRU end 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:34.973+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.001+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.001+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 info.flags=0x13 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.001+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 to cache LRU end 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.001+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.001+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.001+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.070+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11]) start [] num_entries 1100 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.186+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.186+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.186+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.186+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.186+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.232+0000 7f691b60eec0 10 manifest: total_size = 62 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.232+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.312 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.232+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.232+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.233+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.396+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.418+0000 7f691b60eec0 10 manifest: total_size = 62 2019-11-27T13:08:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.418+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.314 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.418+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.418+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.418+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.652+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.703+0000 7f691b60eec0 10 manifest: total_size = 527 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.703+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.313 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.703+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.703+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.703+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 2019-11-27T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.873+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.897+0000 7f691b60eec0 10 manifest: total_size = 2078 2019-11-27T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.897+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.311 2019-11-27T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.897+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.897+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:35.897+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.100+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11]) start _multipart_[] num_entries 1001 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.100+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.244+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.349+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55c3336bf120 s->prefetch_data=0 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.349+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-11-27T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-27T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-11-27T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.375+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.393+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584967 cookie 94296869057712 notifier 4472 bl.length()=181 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.685+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.11 from cache 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.685+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:36.697+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584964 cookie 94296869062224 notifier 4472 bl.length()=239 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.382+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55c3336c4320 s->prefetch_data=0 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.382+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.405+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-11-27T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.405+0000 7f691b60eec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-27T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.405+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.405+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.405+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-11-27T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.405+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.416+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.416+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.416+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.416+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edc0a0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 state=0x55c333600c90 s->prefetch_data=0 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.416+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 : miss 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 info.flags=0x16 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 to cache LRU end 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 20 Read xattr: user.rgw.acl 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 20 Read xattr: user.rgw.idtag 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 : type miss (requested=0x13, cached=0x16) 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.428+0000 7f691b60eec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.449+0000 7f691b60eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.449+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 info.flags=0x13 2019-11-27T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.449+0000 7f691b60eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 to cache LRU end 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.449+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.449+0000 7f691b60eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.449+0000 7f691b60eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.479+0000 7f691b60eec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12]) start [] num_entries 1100 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.518+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.518+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-27T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.518+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.518+0000 7f691b60eec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.518+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.541+0000 7f691b60eec0 10 manifest: total_size = 0 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.541+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.319 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.541+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.541+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.541+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.702+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.799+0000 7f691b60eec0 10 manifest: total_size = 0 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.799+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.321 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.799+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.799+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.799+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 2019-11-27T13:08:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.946+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.977+0000 7f691b60eec0 10 manifest: total_size = 0 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.977+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.320 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.977+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.977+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:37.977+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.195+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.213+0000 7f691b60eec0 10 manifest: total_size = 0 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.213+0000 7f691b60eec0 20 get_obj_state: setting s->obj_tag to dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.318 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.213+0000 7f691b60eec0 20 get_obj_state: rctx=0x7ffcc8edc0c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c3336c4fa8 s->prefetch_data=0 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.213+0000 7f691b60eec0 20 prepare_atomic_modification: state is not atomic. state=0x55c3336c4fa8 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.213+0000 7f691b60eec0 20 bucket index object: default.rgw.buckets.index:.dir.dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.443+0000 7f691b60eec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12]) start _multipart_[] num_entries 1001 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.443+0000 7f691b60eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.577+0000 7f691b60eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12])"; objs.size()=0; is_truncated=0 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.710+0000 7f691b60eec0 20 get_system_obj_state: rctx=0x7ffcc8edba58 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55c3336c44f0 s->prefetch_data=0 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.710+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.732+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:38.744+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584968 cookie 94296869057712 notifier 4472 bl.length()=181 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.141+0000 7f691b60eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.12 from cache 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.141+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.156+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584965 cookie 94296869062224 notifier 4472 bl.length()=239 2019-11-27T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.540+0000 7f691b60eec0 10 removing key index: QQRJHMMZNBMEAIVVSIAY 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.540+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.556+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584969 cookie 94296869068192 notifier 4472 bl.length()=170 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.856+0000 7f691b60eec0 10 removing email index: ragweed.client.0+test@test.test 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.856+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:39.875+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584973 cookie 94296869060656 notifier 4472 bl.length()=182 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.069+0000 7f691b60eec0 10 removing user buckets index 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.069+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-11-27T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.086+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584970 cookie 94296869068192 notifier 4472 bl.length()=173 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.331+0000 7f691b60eec0 10 removing user index: ragweed.client.0 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.331+0000 7f691b60eec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.331+0000 7f691b60eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.349+0000 7f68fe7fc700 10 RGWWatcher::handle_notify() notify_id 579820584974 cookie 94296869065424 notifier 4472 bl.length()=165 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.779+0000 7f691b60eec0 20 remove_watcher() i=0 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.779+0000 7f691b60eec0 2 removed watcher, disabling cache 2019-11-27T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.841+0000 7f691b60eec0 20 remove_watcher() i=1 2019-11-27T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.900+0000 7f691b60eec0 20 remove_watcher() i=2 2019-11-27T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:40.959+0000 7f691b60eec0 20 remove_watcher() i=3 2019-11-27T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:41.000+0000 7f691b60eec0 20 remove_watcher() i=4 2019-11-27T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:41.039+0000 7f691b60eec0 20 remove_watcher() i=5 2019-11-27T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:41.070+0000 7f691b60eec0 20 remove_watcher() i=6 2019-11-27T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:41.149+0000 7f691b60eec0 20 remove_watcher() i=7 2019-11-27T13:08:41.771 INFO:tasks.ragweed:Removing ragweed... 2019-11-27T13:08:41.771 INFO:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/ragweed 2019-11-27T13:08:41.906 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-11-27T13:08:42.015 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-11-27T13:08:42.015 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-11-27T13:08:42.015 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-11-27T13:08:42.016 INFO:teuthology.orchestra.run.smithi005:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-11-27T13:08:42.097 INFO:teuthology.orchestra.run.smithi005.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-11-27T13:08:45.952 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-11-27T13:08:45.953 INFO:teuthology.orchestra.run.smithi005:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-11-27T13:08:48.677 INFO:teuthology.orchestra.run.smithi005.stdout: Gradle will be installed under /opt/gradle 2019-11-27T13:08:48.730 INFO:teuthology.orchestra.run.smithi005.stderr:--2019-11-27 13:08:48-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-11-27T13:08:48.738 INFO:teuthology.orchestra.run.smithi005.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:be09, ... 2019-11-27T13:08:48.746 INFO:teuthology.orchestra.run.smithi005.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-11-27T13:08:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-11-27T13:08:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-11-27T13:08:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:--2019-11-27 13:08:48-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-11-27T13:08:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:9f14, ... 2019-11-27T13:08:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-11-27T13:08:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:HTTP request sent, awaiting response... 200 OK 2019-11-27T13:08:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:Length: 75323957 (72M) [application/zip] 2019-11-27T13:08:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-11-27T13:08:48.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T13:08:48.842 INFO:teuthology.orchestra.run.smithi005.stderr: 0K .......... .......... .......... .......... .......... 0% 6.59M 11s 2019-11-27T13:08:48.842 INFO:teuthology.orchestra.run.smithi005.stderr: 50K .......... .......... .......... .......... .......... 0% 130M 6s 2019-11-27T13:08:48.846 INFO:teuthology.orchestra.run.smithi005.stderr: 100K .......... .......... .......... .......... .......... 0% 7.00M 7s 2019-11-27T13:08:48.848 INFO:teuthology.orchestra.run.smithi005.stderr: 150K .......... .......... .......... .......... .......... 0% 149M 6s 2019-11-27T13:08:48.851 INFO:teuthology.orchestra.run.smithi005.stderr: 200K .......... .......... .......... .......... .......... 0% 109M 5s 2019-11-27T13:08:48.851 INFO:teuthology.orchestra.run.smithi005.stderr: 250K .......... .......... .......... .......... .......... 0% 117M 4s 2019-11-27T13:08:48.854 INFO:teuthology.orchestra.run.smithi005.stderr: 300K .......... .......... .......... .......... .......... 0% 7.67M 5s 2019-11-27T13:08:48.858 INFO:teuthology.orchestra.run.smithi005.stderr: 350K .......... .......... .......... .......... .......... 0% 100M 4s 2019-11-27T13:08:48.859 INFO:teuthology.orchestra.run.smithi005.stderr: 400K .......... .......... .......... .......... .......... 0% 124M 4s 2019-11-27T13:08:48.859 INFO:teuthology.orchestra.run.smithi005.stderr: 450K .......... .......... .......... .......... .......... 0% 156M 3s 2019-11-27T13:08:48.867 INFO:teuthology.orchestra.run.smithi005.stderr: 500K .......... .......... .......... .......... .......... 0% 114M 3s 2019-11-27T13:08:48.867 INFO:teuthology.orchestra.run.smithi005.stderr: 550K .......... .......... .......... .......... .......... 0% 109M 3s 2019-11-27T13:08:48.867 INFO:teuthology.orchestra.run.smithi005.stderr: 600K .......... .......... .......... .......... .......... 0% 154M 3s 2019-11-27T13:08:48.868 INFO:teuthology.orchestra.run.smithi005.stderr: 650K .......... .......... .......... .......... .......... 0% 119M 3s 2019-11-27T13:08:48.868 INFO:teuthology.orchestra.run.smithi005.stderr: 700K .......... .......... .......... .......... .......... 1% 123M 2s 2019-11-27T13:08:48.868 INFO:teuthology.orchestra.run.smithi005.stderr: 750K .......... .......... .......... .......... .......... 1% 95.1M 2s 2019-11-27T13:08:48.868 INFO:teuthology.orchestra.run.smithi005.stderr: 800K .......... .......... .......... .......... .......... 1% 136M 2s 2019-11-27T13:08:48.868 INFO:teuthology.orchestra.run.smithi005.stderr: 850K .......... .......... .......... .......... .......... 1% 14.6M 2s 2019-11-27T13:08:50.054 INFO:teuthology.orchestra.run.smithi005.stderr: 900K .......... .......... .......... .......... .......... 1% 111M 2s 2019-11-27T13:08:50.055 INFO:teuthology.orchestra.run.smithi005.stderr: 950K .......... .......... .......... .......... .......... 1% 83.3M 2s 2019-11-27T13:08:50.055 INFO:teuthology.orchestra.run.smithi005.stderr: 1000K .......... .......... .......... .......... .......... 1% 168M 2s 2019-11-27T13:08:50.055 INFO:teuthology.orchestra.run.smithi005.stderr: 1050K .......... .......... .......... .......... .......... 1% 131M 2s 2019-11-27T13:08:50.055 INFO:teuthology.orchestra.run.smithi005.stderr: 1100K .......... .......... .......... .......... .......... 1% 118M 2s 2019-11-27T13:08:50.055 INFO:teuthology.orchestra.run.smithi005.stderr: 1150K .......... .......... .......... .......... .......... 1% 110M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1200K .......... .......... .......... .......... .......... 1% 118M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1250K .......... .......... .......... .......... .......... 1% 95.2M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1300K .......... .......... .......... .......... .......... 1% 154M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1350K .......... .......... .......... .......... .......... 1% 140M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1400K .......... .......... .......... .......... .......... 1% 154M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1450K .......... .......... .......... .......... .......... 2% 151M 2s 2019-11-27T13:08:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 1500K .......... .......... .......... .......... .......... 2% 151M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1550K .......... .......... .......... .......... .......... 2% 128M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1600K .......... .......... .......... .......... .......... 2% 21.9M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1650K .......... .......... .......... .......... .......... 2% 93.4M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1700K .......... .......... .......... .......... .......... 2% 126M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1750K .......... .......... .......... .......... .......... 2% 211M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1800K .......... .......... .......... .......... .......... 2% 76.4M 2s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1850K .......... .......... .......... .......... .......... 2% 224M 1s 2019-11-27T13:08:50.057 INFO:teuthology.orchestra.run.smithi005.stderr: 1900K .......... .......... .......... .......... .......... 2% 243M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 1950K .......... .......... .......... .......... .......... 2% 185M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2000K .......... .......... .......... .......... .......... 2% 209M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2050K .......... .......... .......... .......... .......... 2% 262M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2100K .......... .......... .......... .......... .......... 2% 257M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2150K .......... .......... .......... .......... .......... 2% 201M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2200K .......... .......... .......... .......... .......... 3% 223M 1s 2019-11-27T13:08:50.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2250K .......... .......... .......... .......... .......... 3% 204M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2300K .......... .......... .......... .......... .......... 3% 231M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2350K .......... .......... .......... .......... .......... 3% 179M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2400K .......... .......... .......... .......... .......... 3% 234M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2450K .......... .......... .......... .......... .......... 3% 217M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2500K .......... .......... .......... .......... .......... 3% 250M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2550K .......... .......... .......... .......... .......... 3% 233M 1s 2019-11-27T13:08:50.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2600K .......... .......... .......... .......... .......... 3% 254M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2650K .......... .......... .......... .......... .......... 3% 265M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2700K .......... .......... .......... .......... .......... 3% 246M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2750K .......... .......... .......... .......... .......... 3% 216M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2800K .......... .......... .......... .......... .......... 3% 263M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2850K .......... .......... .......... .......... .......... 3% 259M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2900K .......... .......... .......... .......... .......... 4% 254M 1s 2019-11-27T13:08:50.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2950K .......... .......... .......... .......... .......... 4% 222M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3000K .......... .......... .......... .......... .......... 4% 257M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3050K .......... .......... .......... .......... .......... 4% 260M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3100K .......... .......... .......... .......... .......... 4% 253M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3150K .......... .......... .......... .......... .......... 4% 207M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3200K .......... .......... .......... .......... .......... 4% 212M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3250K .......... .......... .......... .......... .......... 4% 219M 1s 2019-11-27T13:08:50.061 INFO:teuthology.orchestra.run.smithi005.stderr: 3300K .......... .......... .......... .......... .......... 4% 225M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3350K .......... .......... .......... .......... .......... 4% 203M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3400K .......... .......... .......... .......... .......... 4% 231M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3450K .......... .......... .......... .......... .......... 4% 215M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3500K .......... .......... .......... .......... .......... 4% 247M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3550K .......... .......... .......... .......... .......... 4% 207M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3600K .......... .......... .......... .......... .......... 4% 251M 1s 2019-11-27T13:08:50.062 INFO:teuthology.orchestra.run.smithi005.stderr: 3650K .......... .......... .......... .......... .......... 5% 249M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 3700K .......... .......... .......... .......... .......... 5% 229M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 3750K .......... .......... .......... .......... .......... 5% 228M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 3800K .......... .......... .......... .......... .......... 5% 252M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 3850K .......... .......... .......... .......... .......... 5% 260M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 3900K .......... .......... .......... .......... .......... 5% 249M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 3950K .......... .......... .......... .......... .......... 5% 210M 1s 2019-11-27T13:08:50.063 INFO:teuthology.orchestra.run.smithi005.stderr: 4000K .......... .......... .......... .......... .......... 5% 225M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4050K .......... .......... .......... .......... .......... 5% 222M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4100K .......... .......... .......... .......... .......... 5% 226M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4150K .......... .......... .......... .......... .......... 5% 199M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4200K .......... .......... .......... .......... .......... 5% 206M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4250K .......... .......... .......... .......... .......... 5% 215M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4300K .......... .......... .......... .......... .......... 5% 211M 1s 2019-11-27T13:08:50.064 INFO:teuthology.orchestra.run.smithi005.stderr: 4350K .......... .......... .......... .......... .......... 5% 209M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4400K .......... .......... .......... .......... .......... 6% 255M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4450K .......... .......... .......... .......... .......... 6% 255M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4500K .......... .......... .......... .......... .......... 6% 253M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4550K .......... .......... .......... .......... .......... 6% 229M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4600K .......... .......... .......... .......... .......... 6% 228M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4650K .......... .......... .......... .......... .......... 6% 257M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4700K .......... .......... .......... .......... .......... 6% 254M 1s 2019-11-27T13:08:50.065 INFO:teuthology.orchestra.run.smithi005.stderr: 4750K .......... .......... .......... .......... .......... 6% 229M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 4800K .......... .......... .......... .......... .......... 6% 252M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 4850K .......... .......... .......... .......... .......... 6% 246M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 4900K .......... .......... .......... .......... .......... 6% 279M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 4950K .......... .......... .......... .......... .......... 6% 226M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 5000K .......... .......... .......... .......... .......... 6% 271M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 5050K .......... .......... .......... .......... .......... 6% 274M 1s 2019-11-27T13:08:50.066 INFO:teuthology.orchestra.run.smithi005.stderr: 5100K .......... .......... .......... .......... .......... 7% 263M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5150K .......... .......... .......... .......... .......... 7% 246M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5200K .......... .......... .......... .......... .......... 7% 269M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5250K .......... .......... .......... .......... .......... 7% 274M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5300K .......... .......... .......... .......... .......... 7% 274M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5350K .......... .......... .......... .......... .......... 7% 224M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5400K .......... .......... .......... .......... .......... 7% 276M 1s 2019-11-27T13:08:50.067 INFO:teuthology.orchestra.run.smithi005.stderr: 5450K .......... .......... .......... .......... .......... 7% 275M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5500K .......... .......... .......... .......... .......... 7% 275M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5550K .......... .......... .......... .......... .......... 7% 237M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5600K .......... .......... .......... .......... .......... 7% 10.7M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5650K .......... .......... .......... .......... .......... 7% 237M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5700K .......... .......... .......... .......... .......... 7% 241M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5750K .......... .......... .......... .......... .......... 7% 223M 1s 2019-11-27T13:08:50.068 INFO:teuthology.orchestra.run.smithi005.stderr: 5800K .......... .......... .......... .......... .......... 7% 249M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 5850K .......... .......... .......... .......... .......... 8% 251M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 5900K .......... .......... .......... .......... .......... 8% 235M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 5950K .......... .......... .......... .......... .......... 8% 154M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 6000K .......... .......... .......... .......... .......... 8% 174M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 6050K .......... .......... .......... .......... .......... 8% 219M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 6100K .......... .......... .......... .......... .......... 8% 246M 1s 2019-11-27T13:08:50.069 INFO:teuthology.orchestra.run.smithi005.stderr: 6150K .......... .......... .......... .......... .......... 8% 222M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6200K .......... .......... .......... .......... .......... 8% 234M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6250K .......... .......... .......... .......... .......... 8% 157M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6300K .......... .......... .......... .......... .......... 8% 212M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6350K .......... .......... .......... .......... .......... 8% 154M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6400K .......... .......... .......... .......... .......... 8% 200M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6450K .......... .......... .......... .......... .......... 8% 251M 1s 2019-11-27T13:08:50.070 INFO:teuthology.orchestra.run.smithi005.stderr: 6500K .......... .......... .......... .......... .......... 8% 247M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6550K .......... .......... .......... .......... .......... 8% 224M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6600K .......... .......... .......... .......... .......... 9% 268M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6650K .......... .......... .......... .......... .......... 9% 269M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6700K .......... .......... .......... .......... .......... 9% 273M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6750K .......... .......... .......... .......... .......... 9% 235M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6800K .......... .......... .......... .......... .......... 9% 274M 1s 2019-11-27T13:08:50.071 INFO:teuthology.orchestra.run.smithi005.stderr: 6850K .......... .......... .......... .......... .......... 9% 280M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 6900K .......... .......... .......... .......... .......... 9% 271M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 6950K .......... .......... .......... .......... .......... 9% 241M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 7000K .......... .......... .......... .......... .......... 9% 258M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 7050K .......... .......... .......... .......... .......... 9% 239M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 7100K .......... .......... .......... .......... .......... 9% 236M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 7150K .......... .......... .......... .......... .......... 9% 200M 1s 2019-11-27T13:08:50.072 INFO:teuthology.orchestra.run.smithi005.stderr: 7200K .......... .......... .......... .......... .......... 9% 252M 1s 2019-11-27T13:08:50.073 INFO:teuthology.orchestra.run.smithi005.stderr: 7250K .......... .......... .......... .......... .......... 9% 276M 1s 2019-11-27T13:08:50.075 INFO:teuthology.orchestra.run.smithi005.stderr: 7300K .......... .......... .......... .......... .......... 9% 271M 1s 2019-11-27T13:08:50.075 INFO:teuthology.orchestra.run.smithi005.stderr: 7350K .......... .......... .......... .......... .......... 10% 240M 1s 2019-11-27T13:08:50.075 INFO:teuthology.orchestra.run.smithi005.stderr: 7400K .......... .......... .......... .......... .......... 10% 257M 1s 2019-11-27T13:08:50.075 INFO:teuthology.orchestra.run.smithi005.stderr: 7450K .......... .......... .......... .......... .......... 10% 254M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7500K .......... .......... .......... .......... .......... 10% 281M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7550K .......... .......... .......... .......... .......... 10% 233M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7600K .......... .......... .......... .......... .......... 10% 281M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7650K .......... .......... .......... .......... .......... 10% 276M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7700K .......... .......... .......... .......... .......... 10% 271M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7750K .......... .......... .......... .......... .......... 10% 249M 1s 2019-11-27T13:08:50.076 INFO:teuthology.orchestra.run.smithi005.stderr: 7800K .......... .......... .......... .......... .......... 10% 276M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 7850K .......... .......... .......... .......... .......... 10% 282M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 7900K .......... .......... .......... .......... .......... 10% 268M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 7950K .......... .......... .......... .......... .......... 10% 199M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 8000K .......... .......... .......... .......... .......... 10% 249M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 8050K .......... .......... .......... .......... .......... 11% 243M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 8100K .......... .......... .......... .......... .......... 11% 248M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 8150K .......... .......... .......... .......... .......... 11% 208M 1s 2019-11-27T13:08:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 8200K .......... .......... .......... .......... .......... 11% 238M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8250K .......... .......... .......... .......... .......... 11% 253M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8300K .......... .......... .......... .......... .......... 11% 204M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8350K .......... .......... .......... .......... .......... 11% 174M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8400K .......... .......... .......... .......... .......... 11% 171M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8450K .......... .......... .......... .......... .......... 11% 193M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8500K .......... .......... .......... .......... .......... 11% 233M 1s 2019-11-27T13:08:50.078 INFO:teuthology.orchestra.run.smithi005.stderr: 8550K .......... .......... .......... .......... .......... 11% 230M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8600K .......... .......... .......... .......... .......... 11% 253M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8650K .......... .......... .......... .......... .......... 11% 258M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8700K .......... .......... .......... .......... .......... 11% 255M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8750K .......... .......... .......... .......... .......... 11% 212M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8800K .......... .......... .......... .......... .......... 12% 251M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8850K .......... .......... .......... .......... .......... 12% 254M 1s 2019-11-27T13:08:50.079 INFO:teuthology.orchestra.run.smithi005.stderr: 8900K .......... .......... .......... .......... .......... 12% 259M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 8950K .......... .......... .......... .......... .......... 12% 242M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 9000K .......... .......... .......... .......... .......... 12% 272M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 9050K .......... .......... .......... .......... .......... 12% 271M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 9100K .......... .......... .......... .......... .......... 12% 273M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 9150K .......... .......... .......... .......... .......... 12% 220M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 9200K .......... .......... .......... .......... .......... 12% 274M 1s 2019-11-27T13:08:50.080 INFO:teuthology.orchestra.run.smithi005.stderr: 9250K .......... .......... .......... .......... .......... 12% 277M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9300K .......... .......... .......... .......... .......... 12% 269M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9350K .......... .......... .......... .......... .......... 12% 251M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9400K .......... .......... .......... .......... .......... 12% 264M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9450K .......... .......... .......... .......... .......... 12% 275M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9500K .......... .......... .......... .......... .......... 12% 282M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9550K .......... .......... .......... .......... .......... 13% 223M 1s 2019-11-27T13:08:50.081 INFO:teuthology.orchestra.run.smithi005.stderr: 9600K .......... .......... .......... .......... .......... 13% 238M 1s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9650K .......... .......... .......... .......... .......... 13% 232M 1s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9700K .......... .......... .......... .......... .......... 13% 252M 0s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9750K .......... .......... .......... .......... .......... 13% 232M 0s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9800K .......... .......... .......... .......... .......... 13% 282M 0s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9850K .......... .......... .......... .......... .......... 13% 282M 0s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9900K .......... .......... .......... .......... .......... 13% 281M 0s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 9950K .......... .......... .......... .......... .......... 13% 237M 0s 2019-11-27T13:08:50.082 INFO:teuthology.orchestra.run.smithi005.stderr: 10000K .......... .......... .......... .......... .......... 13% 265M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10050K .......... .......... .......... .......... .......... 13% 292M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10100K .......... .......... .......... .......... .......... 13% 273M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10150K .......... .......... .......... .......... .......... 13% 234M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10200K .......... .......... .......... .......... .......... 13% 251M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10250K .......... .......... .......... .......... .......... 14% 202M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10300K .......... .......... .......... .......... .......... 14% 277M 0s 2019-11-27T13:08:50.083 INFO:teuthology.orchestra.run.smithi005.stderr: 10350K .......... .......... .......... .......... .......... 14% 188M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10400K .......... .......... .......... .......... .......... 14% 236M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10450K .......... .......... .......... .......... .......... 14% 243M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10500K .......... .......... .......... .......... .......... 14% 249M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10550K .......... .......... .......... .......... .......... 14% 223M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10600K .......... .......... .......... .......... .......... 14% 259M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10650K .......... .......... .......... .......... .......... 14% 248M 0s 2019-11-27T13:08:50.084 INFO:teuthology.orchestra.run.smithi005.stderr: 10700K .......... .......... .......... .......... .......... 14% 265M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 10750K .......... .......... .......... .......... .......... 14% 214M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 10800K .......... .......... .......... .......... .......... 14% 273M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 10850K .......... .......... .......... .......... .......... 14% 269M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 10900K .......... .......... .......... .......... .......... 14% 242M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 10950K .......... .......... .......... .......... .......... 14% 221M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 11000K .......... .......... .......... .......... .......... 15% 199M 0s 2019-11-27T13:08:50.085 INFO:teuthology.orchestra.run.smithi005.stderr: 11050K .......... .......... .......... .......... .......... 15% 228M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11100K .......... .......... .......... .......... .......... 15% 371M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11150K .......... .......... .......... .......... .......... 15% 230M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11200K .......... .......... .......... .......... .......... 15% 283M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11250K .......... .......... .......... .......... .......... 15% 262M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11300K .......... .......... .......... .......... .......... 15% 288M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11350K .......... .......... .......... .......... .......... 15% 231M 0s 2019-11-27T13:08:50.086 INFO:teuthology.orchestra.run.smithi005.stderr: 11400K .......... .......... .......... .......... .......... 15% 270M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11450K .......... .......... .......... .......... .......... 15% 223M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11500K .......... .......... .......... .......... .......... 15% 228M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11550K .......... .......... .......... .......... .......... 15% 203M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11600K .......... .......... .......... .......... .......... 15% 244M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11650K .......... .......... .......... .......... .......... 15% 223M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11700K .......... .......... .......... .......... .......... 15% 228M 0s 2019-11-27T13:08:50.087 INFO:teuthology.orchestra.run.smithi005.stderr: 11750K .......... .......... .......... .......... .......... 16% 222M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 11800K .......... .......... .......... .......... .......... 16% 273M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 11850K .......... .......... .......... .......... .......... 16% 275M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 11900K .......... .......... .......... .......... .......... 16% 256M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 11950K .......... .......... .......... .......... .......... 16% 210M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 12000K .......... .......... .......... .......... .......... 16% 252M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 12050K .......... .......... .......... .......... .......... 16% 253M 0s 2019-11-27T13:08:50.088 INFO:teuthology.orchestra.run.smithi005.stderr: 12100K .......... .......... .......... .......... .......... 16% 244M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12150K .......... .......... .......... .......... .......... 16% 224M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12200K .......... .......... .......... .......... .......... 16% 260M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12250K .......... .......... .......... .......... .......... 16% 276M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12300K .......... .......... .......... .......... .......... 16% 275M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12350K .......... .......... .......... .......... .......... 16% 209M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12400K .......... .......... .......... .......... .......... 16% 252M 0s 2019-11-27T13:08:50.089 INFO:teuthology.orchestra.run.smithi005.stderr: 12450K .......... .......... .......... .......... .......... 16% 234M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12500K .......... .......... .......... .......... .......... 17% 275M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12550K .......... .......... .......... .......... .......... 17% 238M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12600K .......... .......... .......... .......... .......... 17% 252M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12650K .......... .......... .......... .......... .......... 17% 268M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12700K .......... .......... .......... .......... .......... 17% 258M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12750K .......... .......... .......... .......... .......... 17% 205M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12800K .......... .......... .......... .......... .......... 17% 247M 0s 2019-11-27T13:08:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 12850K .......... .......... .......... .......... .......... 17% 249M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 12900K .......... .......... .......... .......... .......... 17% 232M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 12950K .......... .......... .......... .......... .......... 17% 203M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 13000K .......... .......... .......... .......... .......... 17% 262M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 13050K .......... .......... .......... .......... .......... 17% 269M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 13100K .......... .......... .......... .......... .......... 17% 203M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 13150K .......... .......... .......... .......... .......... 17% 209M 0s 2019-11-27T13:08:50.091 INFO:teuthology.orchestra.run.smithi005.stderr: 13200K .......... .......... .......... .......... .......... 18% 341M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13250K .......... .......... .......... .......... .......... 18% 362M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13300K .......... .......... .......... .......... .......... 18% 381M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13350K .......... .......... .......... .......... .......... 18% 312M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13400K .......... .......... .......... .......... .......... 18% 238M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13450K .......... .......... .......... .......... .......... 18% 235M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13500K .......... .......... .......... .......... .......... 18% 240M 0s 2019-11-27T13:08:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 13550K .......... .......... .......... .......... .......... 18% 207M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13600K .......... .......... .......... .......... .......... 18% 265M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13650K .......... .......... .......... .......... .......... 18% 257M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13700K .......... .......... .......... .......... .......... 18% 270M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13750K .......... .......... .......... .......... .......... 18% 255M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13800K .......... .......... .......... .......... .......... 18% 269M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13850K .......... .......... .......... .......... .......... 18% 262M 0s 2019-11-27T13:08:50.093 INFO:teuthology.orchestra.run.smithi005.stderr: 13900K .......... .......... .......... .......... .......... 18% 276M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 13950K .......... .......... .......... .......... .......... 19% 217M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 14000K .......... .......... .......... .......... .......... 19% 259M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 14050K .......... .......... .......... .......... .......... 19% 246M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 14100K .......... .......... .......... .......... .......... 19% 238M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 14150K .......... .......... .......... .......... .......... 19% 228M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 14200K .......... .......... .......... .......... .......... 19% 247M 0s 2019-11-27T13:08:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 14250K .......... .......... .......... .......... .......... 19% 236M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14300K .......... .......... .......... .......... .......... 19% 230M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14350K .......... .......... .......... .......... .......... 19% 197M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14400K .......... .......... .......... .......... .......... 19% 239M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14450K .......... .......... .......... .......... .......... 19% 234M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14500K .......... .......... .......... .......... .......... 19% 269M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14550K .......... .......... .......... .......... .......... 19% 215M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14600K .......... .......... .......... .......... .......... 19% 258M 0s 2019-11-27T13:08:50.095 INFO:teuthology.orchestra.run.smithi005.stderr: 14650K .......... .......... .......... .......... .......... 19% 259M 0s 2019-11-27T13:08:50.096 INFO:teuthology.orchestra.run.smithi005.stderr: 14700K .......... .......... .......... .......... .......... 20% 258M 0s 2019-11-27T13:08:50.096 INFO:teuthology.orchestra.run.smithi005.stderr: 14750K .......... .......... .......... .......... .......... 20% 159M 0s 2019-11-27T13:08:50.096 INFO:teuthology.orchestra.run.smithi005.stderr: 14800K .......... .......... .......... .......... .......... 20% 204M 0s 2019-11-27T13:08:50.096 INFO:teuthology.orchestra.run.smithi005.stderr: 14850K .......... .......... .......... .......... .......... 20% 236M 0s 2019-11-27T13:08:50.096 INFO:teuthology.orchestra.run.smithi005.stderr: 14900K .......... .......... .......... .......... .......... 20% 248M 0s 2019-11-27T13:08:50.096 INFO:teuthology.orchestra.run.smithi005.stderr: 14950K .......... .......... .......... .......... .......... 20% 195M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15000K .......... .......... .......... .......... .......... 20% 194M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15050K .......... .......... .......... .......... .......... 20% 253M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15100K .......... .......... .......... .......... .......... 20% 275M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15150K .......... .......... .......... .......... .......... 20% 232M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15200K .......... .......... .......... .......... .......... 20% 284M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15250K .......... .......... .......... .......... .......... 20% 267M 0s 2019-11-27T13:08:50.097 INFO:teuthology.orchestra.run.smithi005.stderr: 15300K .......... .......... .......... .......... .......... 20% 261M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15350K .......... .......... .......... .......... .......... 20% 226M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15400K .......... .......... .......... .......... .......... 21% 286M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15450K .......... .......... .......... .......... .......... 21% 269M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15500K .......... .......... .......... .......... .......... 21% 255M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15550K .......... .......... .......... .......... .......... 21% 226M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15600K .......... .......... .......... .......... .......... 21% 279M 0s 2019-11-27T13:08:50.098 INFO:teuthology.orchestra.run.smithi005.stderr: 15650K .......... .......... .......... .......... .......... 21% 266M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 15700K .......... .......... .......... .......... .......... 21% 250M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 15750K .......... .......... .......... .......... .......... 21% 214M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 15800K .......... .......... .......... .......... .......... 21% 270M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 15850K .......... .......... .......... .......... .......... 21% 234M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 15900K .......... .......... .......... .......... .......... 21% 237M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 15950K .......... .......... .......... .......... .......... 21% 212M 0s 2019-11-27T13:08:50.099 INFO:teuthology.orchestra.run.smithi005.stderr: 16000K .......... .......... .......... .......... .......... 21% 262M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16050K .......... .......... .......... .......... .......... 21% 275M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16100K .......... .......... .......... .......... .......... 21% 255M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16150K .......... .......... .......... .......... .......... 22% 223M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16200K .......... .......... .......... .......... .......... 22% 260M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16250K .......... .......... .......... .......... .......... 22% 262M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16300K .......... .......... .......... .......... .......... 22% 255M 0s 2019-11-27T13:08:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 16350K .......... .......... .......... .......... .......... 22% 201M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16400K .......... .......... .......... .......... .......... 22% 251M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16450K .......... .......... .......... .......... .......... 22% 260M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16500K .......... .......... .......... .......... .......... 22% 251M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16550K .......... .......... .......... .......... .......... 22% 230M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16600K .......... .......... .......... .......... .......... 22% 256M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16650K .......... .......... .......... .......... .......... 22% 216M 0s 2019-11-27T13:08:50.101 INFO:teuthology.orchestra.run.smithi005.stderr: 16700K .......... .......... .......... .......... .......... 22% 196M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 16750K .......... .......... .......... .......... .......... 22% 211M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 16800K .......... .......... .......... .......... .......... 22% 261M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 16850K .......... .......... .......... .......... .......... 22% 268M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 16900K .......... .......... .......... .......... .......... 23% 246M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 16950K .......... .......... .......... .......... .......... 23% 245M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 17000K .......... .......... .......... .......... .......... 23% 274M 0s 2019-11-27T13:08:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 17050K .......... .......... .......... .......... .......... 23% 265M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17100K .......... .......... .......... .......... .......... 23% 277M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17150K .......... .......... .......... .......... .......... 23% 215M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17200K .......... .......... .......... .......... .......... 23% 264M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17250K .......... .......... .......... .......... .......... 23% 266M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17300K .......... .......... .......... .......... .......... 23% 256M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17350K .......... .......... .......... .......... .......... 23% 232M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17400K .......... .......... .......... .......... .......... 23% 256M 0s 2019-11-27T13:08:50.103 INFO:teuthology.orchestra.run.smithi005.stderr: 17450K .......... .......... .......... .......... .......... 23% 269M 0s 2019-11-27T13:08:50.104 INFO:teuthology.orchestra.run.smithi005.stderr: 17500K .......... .......... .......... .......... .......... 23% 311M 0s 2019-11-27T13:08:50.104 INFO:teuthology.orchestra.run.smithi005.stderr: 17550K .......... .......... .......... .......... .......... 23% 195M 0s 2019-11-27T13:08:50.104 INFO:teuthology.orchestra.run.smithi005.stderr: 17600K .......... .......... .......... .......... .......... 23% 219M 0s 2019-11-27T13:08:50.104 INFO:teuthology.orchestra.run.smithi005.stderr: 17650K .......... .......... .......... .......... .......... 24% 198M 0s 2019-11-27T13:08:50.104 INFO:teuthology.orchestra.run.smithi005.stderr: 17700K .......... .......... .......... .......... .......... 24% 254M 0s 2019-11-27T13:08:50.104 INFO:teuthology.orchestra.run.smithi005.stderr: 17750K .......... .......... .......... .......... .......... 24% 227M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 17800K .......... .......... .......... .......... .......... 24% 243M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 17850K .......... .......... .......... .......... .......... 24% 263M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 17900K .......... .......... .......... .......... .......... 24% 245M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 17950K .......... .......... .......... .......... .......... 24% 217M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 18000K .......... .......... .......... .......... .......... 24% 240M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 18050K .......... .......... .......... .......... .......... 24% 250M 0s 2019-11-27T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr: 18100K .......... .......... .......... .......... .......... 24% 251M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18150K .......... .......... .......... .......... .......... 24% 226M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18200K .......... .......... .......... .......... .......... 24% 249M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18250K .......... .......... .......... .......... .......... 24% 271M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18300K .......... .......... .......... .......... .......... 24% 259M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18350K .......... .......... .......... .......... .......... 25% 211M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18400K .......... .......... .......... .......... .......... 25% 267M 0s 2019-11-27T13:08:50.106 INFO:teuthology.orchestra.run.smithi005.stderr: 18450K .......... .......... .......... .......... .......... 25% 261M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18500K .......... .......... .......... .......... .......... 25% 277M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18550K .......... .......... .......... .......... .......... 25% 233M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18600K .......... .......... .......... .......... .......... 25% 266M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18650K .......... .......... .......... .......... .......... 25% 251M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18700K .......... .......... .......... .......... .......... 25% 255M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18750K .......... .......... .......... .......... .......... 25% 226M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18800K .......... .......... .......... .......... .......... 25% 255M 0s 2019-11-27T13:08:50.107 INFO:teuthology.orchestra.run.smithi005.stderr: 18850K .......... .......... .......... .......... .......... 25% 262M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 18900K .......... .......... .......... .......... .......... 25% 244M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 18950K .......... .......... .......... .......... .......... 25% 237M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 19000K .......... .......... .......... .......... .......... 25% 269M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 19050K .......... .......... .......... .......... .......... 25% 257M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 19100K .......... .......... .......... .......... .......... 26% 251M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 19150K .......... .......... .......... .......... .......... 26% 201M 0s 2019-11-27T13:08:50.108 INFO:teuthology.orchestra.run.smithi005.stderr: 19200K .......... .......... .......... .......... .......... 26% 234M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19250K .......... .......... .......... .......... .......... 26% 228M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19300K .......... .......... .......... .......... .......... 26% 205M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19350K .......... .......... .......... .......... .......... 26% 182M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19400K .......... .......... .......... .......... .......... 26% 205M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19450K .......... .......... .......... .......... .......... 26% 200M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19500K .......... .......... .......... .......... .......... 26% 221M 0s 2019-11-27T13:08:50.109 INFO:teuthology.orchestra.run.smithi005.stderr: 19550K .......... .......... .......... .......... .......... 26% 200M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19600K .......... .......... .......... .......... .......... 26% 209M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19650K .......... .......... .......... .......... .......... 26% 209M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19700K .......... .......... .......... .......... .......... 26% 253M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19750K .......... .......... .......... .......... .......... 26% 221M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19800K .......... .......... .......... .......... .......... 26% 253M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19850K .......... .......... .......... .......... .......... 27% 253M 0s 2019-11-27T13:08:50.110 INFO:teuthology.orchestra.run.smithi005.stderr: 19900K .......... .......... .......... .......... .......... 27% 253M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 19950K .......... .......... .......... .......... .......... 27% 218M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20000K .......... .......... .......... .......... .......... 27% 259M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20050K .......... .......... .......... .......... .......... 27% 260M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20100K .......... .......... .......... .......... .......... 27% 251M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20150K .......... .......... .......... .......... .......... 27% 223M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20200K .......... .......... .......... .......... .......... 27% 255M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20250K .......... .......... .......... .......... .......... 27% 251M 0s 2019-11-27T13:08:50.111 INFO:teuthology.orchestra.run.smithi005.stderr: 20300K .......... .......... .......... .......... .......... 27% 271M 0s 2019-11-27T13:08:50.112 INFO:teuthology.orchestra.run.smithi005.stderr: 20350K .......... .......... .......... .......... .......... 27% 211M 0s 2019-11-27T13:08:50.112 INFO:teuthology.orchestra.run.smithi005.stderr: 20400K .......... .......... .......... .......... .......... 27% 270M 0s 2019-11-27T13:08:50.112 INFO:teuthology.orchestra.run.smithi005.stderr: 20450K .......... .......... .......... .......... .......... 27% 243M 0s 2019-11-27T13:08:50.112 INFO:teuthology.orchestra.run.smithi005.stderr: 20500K .......... .......... .......... .......... .......... 27% 269M 0s 2019-11-27T13:08:50.112 INFO:teuthology.orchestra.run.smithi005.stderr: 20550K .......... .......... .......... .......... .......... 28% 210M 0s 2019-11-27T13:08:50.112 INFO:teuthology.orchestra.run.smithi005.stderr: 20600K .......... .......... .......... .......... .......... 28% 238M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20650K .......... .......... .......... .......... .......... 28% 227M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20700K .......... .......... .......... .......... .......... 28% 238M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20750K .......... .......... .......... .......... .......... 28% 212M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20800K .......... .......... .......... .......... .......... 28% 253M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20850K .......... .......... .......... .......... .......... 28% 196M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20900K .......... .......... .......... .......... .......... 28% 229M 0s 2019-11-27T13:08:50.113 INFO:teuthology.orchestra.run.smithi005.stderr: 20950K .......... .......... .......... .......... .......... 28% 182M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21000K .......... .......... .......... .......... .......... 28% 253M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21050K .......... .......... .......... .......... .......... 28% 237M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21100K .......... .......... .......... .......... .......... 28% 244M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21150K .......... .......... .......... .......... .......... 28% 208M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21200K .......... .......... .......... .......... .......... 28% 256M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21250K .......... .......... .......... .......... .......... 28% 239M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21300K .......... .......... .......... .......... .......... 29% 232M 0s 2019-11-27T13:08:50.114 INFO:teuthology.orchestra.run.smithi005.stderr: 21350K .......... .......... .......... .......... .......... 29% 226M 0s 2019-11-27T13:08:50.115 INFO:teuthology.orchestra.run.smithi005.stderr: 21400K .......... .......... .......... .......... .......... 29% 270M 0s 2019-11-27T13:08:50.115 INFO:teuthology.orchestra.run.smithi005.stderr: 21450K .......... .......... .......... .......... .......... 29% 224M 0s 2019-11-27T13:08:50.115 INFO:teuthology.orchestra.run.smithi005.stderr: 21500K .......... .......... .......... .......... .......... 29% 229M 0s 2019-11-27T13:08:50.115 INFO:teuthology.orchestra.run.smithi005.stderr: 21550K .......... .......... .......... .......... .......... 29% 209M 0s 2019-11-27T13:08:50.115 INFO:teuthology.orchestra.run.smithi005.stderr: 21600K .......... .......... .......... .......... .......... 29% 241M 0s 2019-11-27T13:08:50.115 INFO:teuthology.orchestra.run.smithi005.stderr: 21650K .......... .......... .......... .......... .......... 29% 226M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 21700K .......... .......... .......... .......... .......... 29% 262M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 21750K .......... .......... .......... .......... .......... 29% 225M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 21800K .......... .......... .......... .......... .......... 29% 258M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 21850K .......... .......... .......... .......... .......... 29% 262M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 21900K .......... .......... .......... .......... .......... 29% 269M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 21950K .......... .......... .......... .......... .......... 29% 224M 0s 2019-11-27T13:08:50.116 INFO:teuthology.orchestra.run.smithi005.stderr: 22000K .......... .......... .......... .......... .......... 29% 256M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22050K .......... .......... .......... .......... .......... 30% 271M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22100K .......... .......... .......... .......... .......... 30% 258M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22150K .......... .......... .......... .......... .......... 30% 238M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22200K .......... .......... .......... .......... .......... 30% 250M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22250K .......... .......... .......... .......... .......... 30% 232M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22300K .......... .......... .......... .......... .......... 30% 268M 0s 2019-11-27T13:08:50.117 INFO:teuthology.orchestra.run.smithi005.stderr: 22350K .......... .......... .......... .......... .......... 30% 206M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22400K .......... .......... .......... .......... .......... 30% 257M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22450K .......... .......... .......... .......... .......... 30% 250M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22500K .......... .......... .......... .......... .......... 30% 244M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22550K .......... .......... .......... .......... .......... 30% 233M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22600K .......... .......... .......... .......... .......... 30% 262M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22650K .......... .......... .......... .......... .......... 30% 219M 0s 2019-11-27T13:08:50.118 INFO:teuthology.orchestra.run.smithi005.stderr: 22700K .......... .......... .......... .......... .......... 30% 248M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 22750K .......... .......... .......... .......... .......... 30% 193M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 22800K .......... .......... .......... .......... .......... 31% 244M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 22850K .......... .......... .......... .......... .......... 31% 239M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 22900K .......... .......... .......... .......... .......... 31% 237M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 22950K .......... .......... .......... .......... .......... 31% 220M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 23000K .......... .......... .......... .......... .......... 31% 243M 0s 2019-11-27T13:08:50.119 INFO:teuthology.orchestra.run.smithi005.stderr: 23050K .......... .......... .......... .......... .......... 31% 225M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23100K .......... .......... .......... .......... .......... 31% 245M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23150K .......... .......... .......... .......... .......... 31% 212M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23200K .......... .......... .......... .......... .......... 31% 227M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23250K .......... .......... .......... .......... .......... 31% 252M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23300K .......... .......... .......... .......... .......... 31% 236M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23350K .......... .......... .......... .......... .......... 31% 222M 0s 2019-11-27T13:08:50.120 INFO:teuthology.orchestra.run.smithi005.stderr: 23400K .......... .......... .......... .......... .......... 31% 270M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23450K .......... .......... .......... .......... .......... 31% 241M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23500K .......... .......... .......... .......... .......... 32% 331M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23550K .......... .......... .......... .......... .......... 32% 278M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23600K .......... .......... .......... .......... .......... 32% 357M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23650K .......... .......... .......... .......... .......... 32% 268M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23700K .......... .......... .......... .......... .......... 32% 264M 0s 2019-11-27T13:08:50.121 INFO:teuthology.orchestra.run.smithi005.stderr: 23750K .......... .......... .......... .......... .......... 32% 218M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 23800K .......... .......... .......... .......... .......... 32% 275M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 23850K .......... .......... .......... .......... .......... 32% 235M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 23900K .......... .......... .......... .......... .......... 32% 241M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 23950K .......... .......... .......... .......... .......... 32% 215M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 24000K .......... .......... .......... .......... .......... 32% 247M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 24050K .......... .......... .......... .......... .......... 32% 230M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 24100K .......... .......... .......... .......... .......... 32% 217M 0s 2019-11-27T13:08:50.122 INFO:teuthology.orchestra.run.smithi005.stderr: 24150K .......... .......... .......... .......... .......... 32% 218M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24200K .......... .......... .......... .......... .......... 32% 262M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24250K .......... .......... .......... .......... .......... 33% 243M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24300K .......... .......... .......... .......... .......... 33% 236M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24350K .......... .......... .......... .......... .......... 33% 199M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24400K .......... .......... .......... .......... .......... 33% 261M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24450K .......... .......... .......... .......... .......... 33% 244M 0s 2019-11-27T13:08:50.123 INFO:teuthology.orchestra.run.smithi005.stderr: 24500K .......... .......... .......... .......... .......... 33% 223M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24550K .......... .......... .......... .......... .......... 33% 217M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24600K .......... .......... .......... .......... .......... 33% 235M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24650K .......... .......... .......... .......... .......... 33% 245M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24700K .......... .......... .......... .......... .......... 33% 233M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24750K .......... .......... .......... .......... .......... 33% 206M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24800K .......... .......... .......... .......... .......... 33% 249M 0s 2019-11-27T13:08:50.124 INFO:teuthology.orchestra.run.smithi005.stderr: 24850K .......... .......... .......... .......... .......... 33% 268M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 24900K .......... .......... .......... .......... .......... 33% 261M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 24950K .......... .......... .......... .......... .......... 33% 229M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 25000K .......... .......... .......... .......... .......... 34% 258M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 25050K .......... .......... .......... .......... .......... 34% 250M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 25100K .......... .......... .......... .......... .......... 34% 226M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 25150K .......... .......... .......... .......... .......... 34% 193M 0s 2019-11-27T13:08:50.125 INFO:teuthology.orchestra.run.smithi005.stderr: 25200K .......... .......... .......... .......... .......... 34% 205M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25250K .......... .......... .......... .......... .......... 34% 234M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25300K .......... .......... .......... .......... .......... 34% 189M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25350K .......... .......... .......... .......... .......... 34% 241M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25400K .......... .......... .......... .......... .......... 34% 236M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25450K .......... .......... .......... .......... .......... 34% 250M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25500K .......... .......... .......... .......... .......... 34% 266M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25550K .......... .......... .......... .......... .......... 34% 195M 0s 2019-11-27T13:08:50.126 INFO:teuthology.orchestra.run.smithi005.stderr: 25600K .......... .......... .......... .......... .......... 34% 239M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25650K .......... .......... .......... .......... .......... 34% 234M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25700K .......... .......... .......... .......... .......... 35% 238M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25750K .......... .......... .......... .......... .......... 35% 220M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25800K .......... .......... .......... .......... .......... 35% 249M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25850K .......... .......... .......... .......... .......... 35% 253M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25900K .......... .......... .......... .......... .......... 35% 236M 0s 2019-11-27T13:08:50.127 INFO:teuthology.orchestra.run.smithi005.stderr: 25950K .......... .......... .......... .......... .......... 35% 202M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26000K .......... .......... .......... .......... .......... 35% 223M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26050K .......... .......... .......... .......... .......... 35% 226M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26100K .......... .......... .......... .......... .......... 35% 246M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26150K .......... .......... .......... .......... .......... 35% 222M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26200K .......... .......... .......... .......... .......... 35% 270M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26250K .......... .......... .......... .......... .......... 35% 184M 0s 2019-11-27T13:08:50.128 INFO:teuthology.orchestra.run.smithi005.stderr: 26300K .......... .......... .......... .......... .......... 35% 230M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26350K .......... .......... .......... .......... .......... 35% 203M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26400K .......... .......... .......... .......... .......... 35% 229M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26450K .......... .......... .......... .......... .......... 36% 244M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26500K .......... .......... .......... .......... .......... 36% 261M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26550K .......... .......... .......... .......... .......... 36% 226M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26600K .......... .......... .......... .......... .......... 36% 245M 0s 2019-11-27T13:08:50.129 INFO:teuthology.orchestra.run.smithi005.stderr: 26650K .......... .......... .......... .......... .......... 36% 254M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 26700K .......... .......... .......... .......... .......... 36% 251M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 26750K .......... .......... .......... .......... .......... 36% 222M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 26800K .......... .......... .......... .......... .......... 36% 259M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 26850K .......... .......... .......... .......... .......... 36% 236M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 26900K .......... .......... .......... .......... .......... 36% 238M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 26950K .......... .......... .......... .......... .......... 36% 184M 0s 2019-11-27T13:08:50.130 INFO:teuthology.orchestra.run.smithi005.stderr: 27000K .......... .......... .......... .......... .......... 36% 275M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27050K .......... .......... .......... .......... .......... 36% 252M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27100K .......... .......... .......... .......... .......... 36% 246M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27150K .......... .......... .......... .......... .......... 36% 205M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27200K .......... .......... .......... .......... .......... 37% 241M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27250K .......... .......... .......... .......... .......... 37% 243M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27300K .......... .......... .......... .......... .......... 37% 248M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27350K .......... .......... .......... .......... .......... 37% 212M 0s 2019-11-27T13:08:50.131 INFO:teuthology.orchestra.run.smithi005.stderr: 27400K .......... .......... .......... .......... .......... 37% 247M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27450K .......... .......... .......... .......... .......... 37% 247M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27500K .......... .......... .......... .......... .......... 37% 236M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27550K .......... .......... .......... .......... .......... 37% 210M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27600K .......... .......... .......... .......... .......... 37% 260M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27650K .......... .......... .......... .......... .......... 37% 255M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27700K .......... .......... .......... .......... .......... 37% 179M 0s 2019-11-27T13:08:50.132 INFO:teuthology.orchestra.run.smithi005.stderr: 27750K .......... .......... .......... .......... .......... 37% 211M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 27800K .......... .......... .......... .......... .......... 37% 249M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 27850K .......... .......... .......... .......... .......... 37% 244M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 27900K .......... .......... .......... .......... .......... 37% 280M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 27950K .......... .......... .......... .......... .......... 38% 230M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 28000K .......... .......... .......... .......... .......... 38% 267M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 28050K .......... .......... .......... .......... .......... 38% 173M 0s 2019-11-27T13:08:50.133 INFO:teuthology.orchestra.run.smithi005.stderr: 28100K .......... .......... .......... .......... .......... 38% 197M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28150K .......... .......... .......... .......... .......... 38% 187M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28200K .......... .......... .......... .......... .......... 38% 266M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28250K .......... .......... .......... .......... .......... 38% 238M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28300K .......... .......... .......... .......... .......... 38% 260M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28350K .......... .......... .......... .......... .......... 38% 200M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28400K .......... .......... .......... .......... .......... 38% 252M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28450K .......... .......... .......... .......... .......... 38% 269M 0s 2019-11-27T13:08:50.134 INFO:teuthology.orchestra.run.smithi005.stderr: 28500K .......... .......... .......... .......... .......... 38% 236M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28550K .......... .......... .......... .......... .......... 38% 239M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28600K .......... .......... .......... .......... .......... 38% 254M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28650K .......... .......... .......... .......... .......... 39% 217M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28700K .......... .......... .......... .......... .......... 39% 246M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28750K .......... .......... .......... .......... .......... 39% 201M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28800K .......... .......... .......... .......... .......... 39% 252M 0s 2019-11-27T13:08:50.135 INFO:teuthology.orchestra.run.smithi005.stderr: 28850K .......... .......... .......... .......... .......... 39% 237M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 28900K .......... .......... .......... .......... .......... 39% 244M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 28950K .......... .......... .......... .......... .......... 39% 207M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 29000K .......... .......... .......... .......... .......... 39% 226M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 29050K .......... .......... .......... .......... .......... 39% 251M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 29100K .......... .......... .......... .......... .......... 39% 227M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 29150K .......... .......... .......... .......... .......... 39% 192M 0s 2019-11-27T13:08:50.136 INFO:teuthology.orchestra.run.smithi005.stderr: 29200K .......... .......... .......... .......... .......... 39% 259M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29250K .......... .......... .......... .......... .......... 39% 228M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29300K .......... .......... .......... .......... .......... 39% 260M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29350K .......... .......... .......... .......... .......... 39% 222M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29400K .......... .......... .......... .......... .......... 40% 259M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29450K .......... .......... .......... .......... .......... 40% 243M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29500K .......... .......... .......... .......... .......... 40% 267M 0s 2019-11-27T13:08:50.137 INFO:teuthology.orchestra.run.smithi005.stderr: 29550K .......... .......... .......... .......... .......... 40% 196M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29600K .......... .......... .......... .......... .......... 40% 236M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29650K .......... .......... .......... .......... .......... 40% 267M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29700K .......... .......... .......... .......... .......... 40% 262M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29750K .......... .......... .......... .......... .......... 40% 246M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29800K .......... .......... .......... .......... .......... 40% 271M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29850K .......... .......... .......... .......... .......... 40% 253M 0s 2019-11-27T13:08:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 29900K .......... .......... .......... .......... .......... 40% 236M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 29950K .......... .......... .......... .......... .......... 40% 204M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30000K .......... .......... .......... .......... .......... 40% 277M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30050K .......... .......... .......... .......... .......... 40% 254M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30100K .......... .......... .......... .......... .......... 40% 264M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30150K .......... .......... .......... .......... .......... 41% 233M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30200K .......... .......... .......... .......... .......... 41% 253M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30250K .......... .......... .......... .......... .......... 41% 268M 0s 2019-11-27T13:08:50.139 INFO:teuthology.orchestra.run.smithi005.stderr: 30300K .......... .......... .......... .......... .......... 41% 260M 0s 2019-11-27T13:08:50.140 INFO:teuthology.orchestra.run.smithi005.stderr: 30350K .......... .......... .......... .......... .......... 41% 200M 0s 2019-11-27T13:08:50.140 INFO:teuthology.orchestra.run.smithi005.stderr: 30400K .......... .......... .......... .......... .......... 41% 252M 0s 2019-11-27T13:08:50.140 INFO:teuthology.orchestra.run.smithi005.stderr: 30450K .......... .......... .......... .......... .......... 41% 248M 0s 2019-11-27T13:08:50.140 INFO:teuthology.orchestra.run.smithi005.stderr: 30500K .......... .......... .......... .......... .......... 41% 221M 0s 2019-11-27T13:08:50.140 INFO:teuthology.orchestra.run.smithi005.stderr: 30550K .......... .......... .......... .......... .......... 41% 238M 0s 2019-11-27T13:08:50.140 INFO:teuthology.orchestra.run.smithi005.stderr: 30600K .......... .......... .......... .......... .......... 41% 245M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30650K .......... .......... .......... .......... .......... 41% 254M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30700K .......... .......... .......... .......... .......... 41% 228M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30750K .......... .......... .......... .......... .......... 41% 207M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30800K .......... .......... .......... .......... .......... 41% 256M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30850K .......... .......... .......... .......... .......... 42% 228M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30900K .......... .......... .......... .......... .......... 42% 249M 0s 2019-11-27T13:08:50.141 INFO:teuthology.orchestra.run.smithi005.stderr: 30950K .......... .......... .......... .......... .......... 42% 215M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31000K .......... .......... .......... .......... .......... 42% 237M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31050K .......... .......... .......... .......... .......... 42% 250M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31100K .......... .......... .......... .......... .......... 42% 173M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31150K .......... .......... .......... .......... .......... 42% 220M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31200K .......... .......... .......... .......... .......... 42% 244M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31250K .......... .......... .......... .......... .......... 42% 253M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31300K .......... .......... .......... .......... .......... 42% 261M 0s 2019-11-27T13:08:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 31350K .......... .......... .......... .......... .......... 42% 223M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31400K .......... .......... .......... .......... .......... 42% 229M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31450K .......... .......... .......... .......... .......... 42% 258M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31500K .......... .......... .......... .......... .......... 42% 264M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31550K .......... .......... .......... .......... .......... 42% 205M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31600K .......... .......... .......... .......... .......... 43% 268M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31650K .......... .......... .......... .......... .......... 43% 268M 0s 2019-11-27T13:08:50.143 INFO:teuthology.orchestra.run.smithi005.stderr: 31700K .......... .......... .......... .......... .......... 43% 228M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 31750K .......... .......... .......... .......... .......... 43% 206M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 31800K .......... .......... .......... .......... .......... 43% 245M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 31850K .......... .......... .......... .......... .......... 43% 256M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 31900K .......... .......... .......... .......... .......... 43% 223M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 31950K .......... .......... .......... .......... .......... 43% 200M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 32000K .......... .......... .......... .......... .......... 43% 252M 0s 2019-11-27T13:08:50.144 INFO:teuthology.orchestra.run.smithi005.stderr: 32050K .......... .......... .......... .......... .......... 43% 243M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32100K .......... .......... .......... .......... .......... 43% 220M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32150K .......... .......... .......... .......... .......... 43% 183M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32200K .......... .......... .......... .......... .......... 43% 214M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32250K .......... .......... .......... .......... .......... 43% 170M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32300K .......... .......... .......... .......... .......... 43% 216M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32350K .......... .......... .......... .......... .......... 44% 212M 0s 2019-11-27T13:08:50.145 INFO:teuthology.orchestra.run.smithi005.stderr: 32400K .......... .......... .......... .......... .......... 44% 207M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32450K .......... .......... .......... .......... .......... 44% 254M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32500K .......... .......... .......... .......... .......... 44% 268M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32550K .......... .......... .......... .......... .......... 44% 230M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32600K .......... .......... .......... .......... .......... 44% 259M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32650K .......... .......... .......... .......... .......... 44% 264M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32700K .......... .......... .......... .......... .......... 44% 258M 0s 2019-11-27T13:08:50.146 INFO:teuthology.orchestra.run.smithi005.stderr: 32750K .......... .......... .......... .......... .......... 44% 218M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 32800K .......... .......... .......... .......... .......... 44% 264M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 32850K .......... .......... .......... .......... .......... 44% 249M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 32900K .......... .......... .......... .......... .......... 44% 249M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 32950K .......... .......... .......... .......... .......... 44% 236M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 33000K .......... .......... .......... .......... .......... 44% 258M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 33050K .......... .......... .......... .......... .......... 44% 267M 0s 2019-11-27T13:08:50.147 INFO:teuthology.orchestra.run.smithi005.stderr: 33100K .......... .......... .......... .......... .......... 45% 247M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33150K .......... .......... .......... .......... .......... 45% 223M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33200K .......... .......... .......... .......... .......... 45% 206M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33250K .......... .......... .......... .......... .......... 45% 229M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33300K .......... .......... .......... .......... .......... 45% 217M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33350K .......... .......... .......... .......... .......... 45% 185M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33400K .......... .......... .......... .......... .......... 45% 203M 0s 2019-11-27T13:08:50.148 INFO:teuthology.orchestra.run.smithi005.stderr: 33450K .......... .......... .......... .......... .......... 45% 221M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33500K .......... .......... .......... .......... .......... 45% 201M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33550K .......... .......... .......... .......... .......... 45% 207M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33600K .......... .......... .......... .......... .......... 45% 252M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33650K .......... .......... .......... .......... .......... 45% 232M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33700K .......... .......... .......... .......... .......... 45% 255M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33750K .......... .......... .......... .......... .......... 45% 228M 0s 2019-11-27T13:08:50.149 INFO:teuthology.orchestra.run.smithi005.stderr: 33800K .......... .......... .......... .......... .......... 46% 242M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 33850K .......... .......... .......... .......... .......... 46% 269M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 33900K .......... .......... .......... .......... .......... 46% 248M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 33950K .......... .......... .......... .......... .......... 46% 213M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 34000K .......... .......... .......... .......... .......... 46% 241M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 34050K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 34100K .......... .......... .......... .......... .......... 46% 221M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 34150K .......... .......... .......... .......... .......... 46% 214M 0s 2019-11-27T13:08:50.150 INFO:teuthology.orchestra.run.smithi005.stderr: 34200K .......... .......... .......... .......... .......... 46% 274M 0s 2019-11-27T13:08:50.151 INFO:teuthology.orchestra.run.smithi005.stderr: 34250K .......... .......... .......... .......... .......... 46% 245M 0s 2019-11-27T13:08:50.151 INFO:teuthology.orchestra.run.smithi005.stderr: 34300K .......... .......... .......... .......... .......... 46% 242M 0s 2019-11-27T13:08:50.151 INFO:teuthology.orchestra.run.smithi005.stderr: 34350K .......... .......... .......... .......... .......... 46% 210M 0s 2019-11-27T13:08:50.151 INFO:teuthology.orchestra.run.smithi005.stderr: 34400K .......... .......... .......... .......... .......... 46% 241M 0s 2019-11-27T13:08:50.151 INFO:teuthology.orchestra.run.smithi005.stderr: 34450K .......... .......... .......... .......... .......... 46% 259M 0s 2019-11-27T13:08:50.151 INFO:teuthology.orchestra.run.smithi005.stderr: 34500K .......... .......... .......... .......... .......... 46% 241M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34550K .......... .......... .......... .......... .......... 47% 218M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34600K .......... .......... .......... .......... .......... 47% 239M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34650K .......... .......... .......... .......... .......... 47% 264M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34700K .......... .......... .......... .......... .......... 47% 254M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34750K .......... .......... .......... .......... .......... 47% 211M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34800K .......... .......... .......... .......... .......... 47% 249M 0s 2019-11-27T13:08:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 34850K .......... .......... .......... .......... .......... 47% 229M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 34900K .......... .......... .......... .......... .......... 47% 218M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 34950K .......... .......... .......... .......... .......... 47% 215M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 35000K .......... .......... .......... .......... .......... 47% 265M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 35050K .......... .......... .......... .......... .......... 47% 260M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 35100K .......... .......... .......... .......... .......... 47% 267M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 35150K .......... .......... .......... .......... .......... 47% 221M 0s 2019-11-27T13:08:50.153 INFO:teuthology.orchestra.run.smithi005.stderr: 35200K .......... .......... .......... .......... .......... 47% 264M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35250K .......... .......... .......... .......... .......... 47% 189M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35300K .......... .......... .......... .......... .......... 48% 243M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35350K .......... .......... .......... .......... .......... 48% 191M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35400K .......... .......... .......... .......... .......... 48% 232M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35450K .......... .......... .......... .......... .......... 48% 235M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35500K .......... .......... .......... .......... .......... 48% 170M 0s 2019-11-27T13:08:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 35550K .......... .......... .......... .......... .......... 48% 195M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35600K .......... .......... .......... .......... .......... 48% 212M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35650K .......... .......... .......... .......... .......... 48% 179M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35700K .......... .......... .......... .......... .......... 48% 221M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35750K .......... .......... .......... .......... .......... 48% 188M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35800K .......... .......... .......... .......... .......... 48% 233M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35850K .......... .......... .......... .......... .......... 48% 232M 0s 2019-11-27T13:08:50.155 INFO:teuthology.orchestra.run.smithi005.stderr: 35900K .......... .......... .......... .......... .......... 48% 249M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 35950K .......... .......... .......... .......... .......... 48% 200M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 36000K .......... .......... .......... .......... .......... 49% 231M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 36050K .......... .......... .......... .......... .......... 49% 261M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 36100K .......... .......... .......... .......... .......... 49% 262M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 36150K .......... .......... .......... .......... .......... 49% 237M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 36200K .......... .......... .......... .......... .......... 49% 248M 0s 2019-11-27T13:08:50.156 INFO:teuthology.orchestra.run.smithi005.stderr: 36250K .......... .......... .......... .......... .......... 49% 211M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36300K .......... .......... .......... .......... .......... 49% 198M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36350K .......... .......... .......... .......... .......... 49% 176M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36400K .......... .......... .......... .......... .......... 49% 256M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36450K .......... .......... .......... .......... .......... 49% 253M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36500K .......... .......... .......... .......... .......... 49% 268M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36550K .......... .......... .......... .......... .......... 49% 231M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36600K .......... .......... .......... .......... .......... 49% 268M 0s 2019-11-27T13:08:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 36650K .......... .......... .......... .......... .......... 49% 268M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 36700K .......... .......... .......... .......... .......... 49% 257M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 36750K .......... .......... .......... .......... .......... 50% 207M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 36800K .......... .......... .......... .......... .......... 50% 251M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 36850K .......... .......... .......... .......... .......... 50% 268M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 36900K .......... .......... .......... .......... .......... 50% 268M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 36950K .......... .......... .......... .......... .......... 50% 231M 0s 2019-11-27T13:08:50.158 INFO:teuthology.orchestra.run.smithi005.stderr: 37000K .......... .......... .......... .......... .......... 50% 248M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37050K .......... .......... .......... .......... .......... 50% 257M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37100K .......... .......... .......... .......... .......... 50% 260M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37150K .......... .......... .......... .......... .......... 50% 226M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37200K .......... .......... .......... .......... .......... 50% 248M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37250K .......... .......... .......... .......... .......... 50% 262M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37300K .......... .......... .......... .......... .......... 50% 248M 0s 2019-11-27T13:08:50.159 INFO:teuthology.orchestra.run.smithi005.stderr: 37350K .......... .......... .......... .......... .......... 50% 225M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37400K .......... .......... .......... .......... .......... 50% 272M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37450K .......... .......... .......... .......... .......... 50% 239M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37500K .......... .......... .......... .......... .......... 51% 243M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37550K .......... .......... .......... .......... .......... 51% 191M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37600K .......... .......... .......... .......... .......... 51% 253M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37650K .......... .......... .......... .......... .......... 51% 245M 0s 2019-11-27T13:08:50.160 INFO:teuthology.orchestra.run.smithi005.stderr: 37700K .......... .......... .......... .......... .......... 51% 246M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 37750K .......... .......... .......... .......... .......... 51% 222M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 37800K .......... .......... .......... .......... .......... 51% 235M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 37850K .......... .......... .......... .......... .......... 51% 243M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 37900K .......... .......... .......... .......... .......... 51% 241M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 37950K .......... .......... .......... .......... .......... 51% 213M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 38000K .......... .......... .......... .......... .......... 51% 232M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 38050K .......... .......... .......... .......... .......... 51% 248M 0s 2019-11-27T13:08:50.161 INFO:teuthology.orchestra.run.smithi005.stderr: 38100K .......... .......... .......... .......... .......... 51% 234M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38150K .......... .......... .......... .......... .......... 51% 222M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38200K .......... .......... .......... .......... .......... 51% 213M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38250K .......... .......... .......... .......... .......... 52% 241M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38300K .......... .......... .......... .......... .......... 52% 258M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38350K .......... .......... .......... .......... .......... 52% 216M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38400K .......... .......... .......... .......... .......... 52% 261M 0s 2019-11-27T13:08:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 38450K .......... .......... .......... .......... .......... 52% 264M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38500K .......... .......... .......... .......... .......... 52% 257M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38550K .......... .......... .......... .......... .......... 52% 227M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38600K .......... .......... .......... .......... .......... 52% 264M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38650K .......... .......... .......... .......... .......... 52% 235M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38700K .......... .......... .......... .......... .......... 52% 260M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38750K .......... .......... .......... .......... .......... 52% 214M 0s 2019-11-27T13:08:50.163 INFO:teuthology.orchestra.run.smithi005.stderr: 38800K .......... .......... .......... .......... .......... 52% 240M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 38850K .......... .......... .......... .......... .......... 52% 248M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 38900K .......... .......... .......... .......... .......... 52% 252M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 38950K .......... .......... .......... .......... .......... 53% 225M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 39000K .......... .......... .......... .......... .......... 53% 257M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 39050K .......... .......... .......... .......... .......... 53% 219M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 39100K .......... .......... .......... .......... .......... 53% 248M 0s 2019-11-27T13:08:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 39150K .......... .......... .......... .......... .......... 53% 188M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39200K .......... .......... .......... .......... .......... 53% 236M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39250K .......... .......... .......... .......... .......... 53% 194M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39300K .......... .......... .......... .......... .......... 53% 204M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39350K .......... .......... .......... .......... .......... 53% 187M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39400K .......... .......... .......... .......... .......... 53% 204M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39450K .......... .......... .......... .......... .......... 53% 218M 0s 2019-11-27T13:08:50.165 INFO:teuthology.orchestra.run.smithi005.stderr: 39500K .......... .......... .......... .......... .......... 53% 233M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39550K .......... .......... .......... .......... .......... 53% 193M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39600K .......... .......... .......... .......... .......... 53% 233M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39650K .......... .......... .......... .......... .......... 53% 251M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39700K .......... .......... .......... .......... .......... 54% 249M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39750K .......... .......... .......... .......... .......... 54% 221M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39800K .......... .......... .......... .......... .......... 54% 244M 0s 2019-11-27T13:08:50.166 INFO:teuthology.orchestra.run.smithi005.stderr: 39850K .......... .......... .......... .......... .......... 54% 252M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 39900K .......... .......... .......... .......... .......... 54% 257M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 39950K .......... .......... .......... .......... .......... 54% 208M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 40000K .......... .......... .......... .......... .......... 54% 252M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 40050K .......... .......... .......... .......... .......... 54% 253M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 40100K .......... .......... .......... .......... .......... 54% 258M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 40150K .......... .......... .......... .......... .......... 54% 232M 0s 2019-11-27T13:08:50.167 INFO:teuthology.orchestra.run.smithi005.stderr: 40200K .......... .......... .......... .......... .......... 54% 262M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40250K .......... .......... .......... .......... .......... 54% 269M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40300K .......... .......... .......... .......... .......... 54% 252M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40350K .......... .......... .......... .......... .......... 54% 209M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40400K .......... .......... .......... .......... .......... 54% 236M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40450K .......... .......... .......... .......... .......... 55% 227M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40500K .......... .......... .......... .......... .......... 55% 246M 0s 2019-11-27T13:08:50.168 INFO:teuthology.orchestra.run.smithi005.stderr: 40550K .......... .......... .......... .......... .......... 55% 214M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40600K .......... .......... .......... .......... .......... 55% 237M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40650K .......... .......... .......... .......... .......... 55% 236M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40700K .......... .......... .......... .......... .......... 55% 241M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40750K .......... .......... .......... .......... .......... 55% 209M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40800K .......... .......... .......... .......... .......... 55% 235M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40850K .......... .......... .......... .......... .......... 55% 256M 0s 2019-11-27T13:08:50.169 INFO:teuthology.orchestra.run.smithi005.stderr: 40900K .......... .......... .......... .......... .......... 55% 255M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 40950K .......... .......... .......... .......... .......... 55% 221M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41000K .......... .......... .......... .......... .......... 55% 255M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41050K .......... .......... .......... .......... .......... 55% 220M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41100K .......... .......... .......... .......... .......... 55% 241M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41150K .......... .......... .......... .......... .......... 56% 166M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41200K .......... .......... .......... .......... .......... 56% 225M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41250K .......... .......... .......... .......... .......... 56% 212M 0s 2019-11-27T13:08:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 41300K .......... .......... .......... .......... .......... 56% 194M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41350K .......... .......... .......... .......... .......... 56% 124M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41400K .......... .......... .......... .......... .......... 56% 148M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41450K .......... .......... .......... .......... .......... 56% 179M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41500K .......... .......... .......... .......... .......... 56% 180M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41550K .......... .......... .......... .......... .......... 56% 183M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41600K .......... .......... .......... .......... .......... 56% 238M 0s 2019-11-27T13:08:50.171 INFO:teuthology.orchestra.run.smithi005.stderr: 41650K .......... .......... .......... .......... .......... 56% 245M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 41700K .......... .......... .......... .......... .......... 56% 232M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 41750K .......... .......... .......... .......... .......... 56% 201M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 41800K .......... .......... .......... .......... .......... 56% 261M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 41850K .......... .......... .......... .......... .......... 56% 232M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 41900K .......... .......... .......... .......... .......... 57% 208M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 41950K .......... .......... .......... .......... .......... 57% 174M 0s 2019-11-27T13:08:50.172 INFO:teuthology.orchestra.run.smithi005.stderr: 42000K .......... .......... .......... .......... .......... 57% 216M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42050K .......... .......... .......... .......... .......... 57% 242M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42100K .......... .......... .......... .......... .......... 57% 338M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42150K .......... .......... .......... .......... .......... 57% 316M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42200K .......... .......... .......... .......... .......... 57% 237M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42250K .......... .......... .......... .......... .......... 57% 241M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42300K .......... .......... .......... .......... .......... 57% 289M 0s 2019-11-27T13:08:50.173 INFO:teuthology.orchestra.run.smithi005.stderr: 42350K .......... .......... .......... .......... .......... 57% 201M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42400K .......... .......... .......... .......... .......... 57% 356M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42450K .......... .......... .......... .......... .......... 57% 293M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42500K .......... .......... .......... .......... .......... 57% 264M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42550K .......... .......... .......... .......... .......... 57% 269M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42600K .......... .......... .......... .......... .......... 57% 314M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42650K .......... .......... .......... .......... .......... 58% 299M 0s 2019-11-27T13:08:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 42700K .......... .......... .......... .......... .......... 58% 367M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 42750K .......... .......... .......... .......... .......... 58% 272M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 42800K .......... .......... .......... .......... .......... 58% 334M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 42850K .......... .......... .......... .......... .......... 58% 309M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 42900K .......... .......... .......... .......... .......... 58% 301M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 42950K .......... .......... .......... .......... .......... 58% 295M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 43000K .......... .......... .......... .......... .......... 58% 296M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 43050K .......... .......... .......... .......... .......... 58% 296M 0s 2019-11-27T13:08:50.175 INFO:teuthology.orchestra.run.smithi005.stderr: 43100K .......... .......... .......... .......... .......... 58% 313M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43150K .......... .......... .......... .......... .......... 58% 304M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43200K .......... .......... .......... .......... .......... 58% 262M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43250K .......... .......... .......... .......... .......... 58% 340M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43300K .......... .......... .......... .......... .......... 58% 367M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43350K .......... .......... .......... .......... .......... 59% 266M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43400K .......... .......... .......... .......... .......... 59% 274M 0s 2019-11-27T13:08:50.176 INFO:teuthology.orchestra.run.smithi005.stderr: 43450K .......... .......... .......... .......... .......... 59% 361M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43500K .......... .......... .......... .......... .......... 59% 371M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43550K .......... .......... .......... .......... .......... 59% 279M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43600K .......... .......... .......... .......... .......... 59% 291M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43650K .......... .......... .......... .......... .......... 59% 368M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43700K .......... .......... .......... .......... .......... 59% 356M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43750K .......... .......... .......... .......... .......... 59% 263M 0s 2019-11-27T13:08:50.177 INFO:teuthology.orchestra.run.smithi005.stderr: 43800K .......... .......... .......... .......... .......... 59% 352M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 43850K .......... .......... .......... .......... .......... 59% 308M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 43900K .......... .......... .......... .......... .......... 59% 281M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 43950K .......... .......... .......... .......... .......... 59% 298M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 44000K .......... .......... .......... .......... .......... 59% 324M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 44050K .......... .......... .......... .......... .......... 59% 303M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 44100K .......... .......... .......... .......... .......... 60% 360M 0s 2019-11-27T13:08:50.178 INFO:teuthology.orchestra.run.smithi005.stderr: 44150K .......... .......... .......... .......... .......... 60% 263M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44200K .......... .......... .......... .......... .......... 60% 328M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44250K .......... .......... .......... .......... .......... 60% 329M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44300K .......... .......... .......... .......... .......... 60% 295M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44350K .......... .......... .......... .......... .......... 60% 269M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44400K .......... .......... .......... .......... .......... 60% 279M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44450K .......... .......... .......... .......... .......... 60% 347M 0s 2019-11-27T13:08:50.179 INFO:teuthology.orchestra.run.smithi005.stderr: 44500K .......... .......... .......... .......... .......... 60% 323M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44550K .......... .......... .......... .......... .......... 60% 234M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44600K .......... .......... .......... .......... .......... 60% 274M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44650K .......... .......... .......... .......... .......... 60% 279M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44700K .......... .......... .......... .......... .......... 60% 342M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44750K .......... .......... .......... .......... .......... 60% 308M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44800K .......... .......... .......... .......... .......... 60% 287M 0s 2019-11-27T13:08:50.180 INFO:teuthology.orchestra.run.smithi005.stderr: 44850K .......... .......... .......... .......... .......... 61% 233M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 44900K .......... .......... .......... .......... .......... 61% 337M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 44950K .......... .......... .......... .......... .......... 61% 255M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 45000K .......... .......... .......... .......... .......... 61% 365M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 45050K .......... .......... .......... .......... .......... 61% 374M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 45100K .......... .......... .......... .......... .......... 61% 343M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 45150K .......... .......... .......... .......... .......... 61% 263M 0s 2019-11-27T13:08:50.181 INFO:teuthology.orchestra.run.smithi005.stderr: 45200K .......... .......... .......... .......... .......... 61% 339M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45250K .......... .......... .......... .......... .......... 61% 331M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45300K .......... .......... .......... .......... .......... 61% 317M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45350K .......... .......... .......... .......... .......... 61% 303M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45400K .......... .......... .......... .......... .......... 61% 334M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45450K .......... .......... .......... .......... .......... 61% 321M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45500K .......... .......... .......... .......... .......... 61% 347M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45550K .......... .......... .......... .......... .......... 61% 299M 0s 2019-11-27T13:08:50.182 INFO:teuthology.orchestra.run.smithi005.stderr: 45600K .......... .......... .......... .......... .......... 62% 338M 0s 2019-11-27T13:08:50.183 INFO:teuthology.orchestra.run.smithi005.stderr: 45650K .......... .......... .......... .......... .......... 62% 331M 0s 2019-11-27T13:08:50.183 INFO:teuthology.orchestra.run.smithi005.stderr: 45700K .......... .......... .......... .......... .......... 62% 339M 0s 2019-11-27T13:08:50.183 INFO:teuthology.orchestra.run.smithi005.stderr: 45750K .......... .......... .......... .......... .......... 62% 261M 0s 2019-11-27T13:08:50.183 INFO:teuthology.orchestra.run.smithi005.stderr: 45800K .......... .......... .......... .......... .......... 62% 342M 0s 2019-11-27T13:08:50.183 INFO:teuthology.orchestra.run.smithi005.stderr: 45850K .......... .......... .......... .......... .......... 62% 326M 0s 2019-11-27T13:08:50.183 INFO:teuthology.orchestra.run.smithi005.stderr: 45900K .......... .......... .......... .......... .......... 62% 350M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 45950K .......... .......... .......... .......... .......... 62% 290M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46000K .......... .......... .......... .......... .......... 62% 322M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46050K .......... .......... .......... .......... .......... 62% 355M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46100K .......... .......... .......... .......... .......... 62% 317M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46150K .......... .......... .......... .......... .......... 62% 258M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46200K .......... .......... .......... .......... .......... 62% 326M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46250K .......... .......... .......... .......... .......... 62% 315M 0s 2019-11-27T13:08:50.184 INFO:teuthology.orchestra.run.smithi005.stderr: 46300K .......... .......... .......... .......... .......... 63% 353M 0s 2019-11-27T13:08:50.185 INFO:teuthology.orchestra.run.smithi005.stderr: 46350K .......... .......... .......... .......... .......... 63% 237M 0s 2019-11-27T13:08:50.185 INFO:teuthology.orchestra.run.smithi005.stderr: 46400K .......... .......... .......... .......... .......... 63% 354M 0s 2019-11-27T13:08:50.185 INFO:teuthology.orchestra.run.smithi005.stderr: 46450K .......... .......... .......... .......... .......... 63% 345M 0s 2019-11-27T13:08:50.185 INFO:teuthology.orchestra.run.smithi005.stderr: 46500K .......... .......... .......... .......... .......... 63% 330M 0s 2019-11-27T13:08:50.185 INFO:teuthology.orchestra.run.smithi005.stderr: 46550K .......... .......... .......... .......... .......... 63% 254M 0s 2019-11-27T13:08:50.185 INFO:teuthology.orchestra.run.smithi005.stderr: 46600K .......... .......... .......... .......... .......... 63% 363M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46650K .......... .......... .......... .......... .......... 63% 332M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46700K .......... .......... .......... .......... .......... 63% 341M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46750K .......... .......... .......... .......... .......... 63% 310M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46800K .......... .......... .......... .......... .......... 63% 316M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46850K .......... .......... .......... .......... .......... 63% 296M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46900K .......... .......... .......... .......... .......... 63% 313M 0s 2019-11-27T13:08:50.186 INFO:teuthology.orchestra.run.smithi005.stderr: 46950K .......... .......... .......... .......... .......... 63% 274M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47000K .......... .......... .......... .......... .......... 63% 316M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47050K .......... .......... .......... .......... .......... 64% 311M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47100K .......... .......... .......... .......... .......... 64% 353M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47150K .......... .......... .......... .......... .......... 64% 305M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47200K .......... .......... .......... .......... .......... 64% 308M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47250K .......... .......... .......... .......... .......... 64% 325M 0s 2019-11-27T13:08:50.187 INFO:teuthology.orchestra.run.smithi005.stderr: 47300K .......... .......... .......... .......... .......... 64% 319M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47350K .......... .......... .......... .......... .......... 64% 275M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47400K .......... .......... .......... .......... .......... 64% 308M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47450K .......... .......... .......... .......... .......... 64% 348M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47500K .......... .......... .......... .......... .......... 64% 368M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47550K .......... .......... .......... .......... .......... 64% 251M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47600K .......... .......... .......... .......... .......... 64% 325M 0s 2019-11-27T13:08:50.188 INFO:teuthology.orchestra.run.smithi005.stderr: 47650K .......... .......... .......... .......... .......... 64% 318M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 47700K .......... .......... .......... .......... .......... 64% 342M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 47750K .......... .......... .......... .......... .......... 64% 258M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 47800K .......... .......... .......... .......... .......... 65% 324M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 47850K .......... .......... .......... .......... .......... 65% 331M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 47900K .......... .......... .......... .......... .......... 65% 324M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 47950K .......... .......... .......... .......... .......... 65% 298M 0s 2019-11-27T13:08:50.189 INFO:teuthology.orchestra.run.smithi005.stderr: 48000K .......... .......... .......... .......... .......... 65% 323M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48050K .......... .......... .......... .......... .......... 65% 325M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48100K .......... .......... .......... .......... .......... 65% 332M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48150K .......... .......... .......... .......... .......... 65% 271M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48200K .......... .......... .......... .......... .......... 65% 332M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48250K .......... .......... .......... .......... .......... 65% 276M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48300K .......... .......... .......... .......... .......... 65% 281M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48350K .......... .......... .......... .......... .......... 65% 280M 0s 2019-11-27T13:08:50.190 INFO:teuthology.orchestra.run.smithi005.stderr: 48400K .......... .......... .......... .......... .......... 65% 286M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48450K .......... .......... .......... .......... .......... 65% 281M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48500K .......... .......... .......... .......... .......... 66% 236M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48550K .......... .......... .......... .......... .......... 66% 251M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48600K .......... .......... .......... .......... .......... 66% 295M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48650K .......... .......... .......... .......... .......... 66% 334M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48700K .......... .......... .......... .......... .......... 66% 371M 0s 2019-11-27T13:08:50.191 INFO:teuthology.orchestra.run.smithi005.stderr: 48750K .......... .......... .......... .......... .......... 66% 239M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 48800K .......... .......... .......... .......... .......... 66% 311M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 48850K .......... .......... .......... .......... .......... 66% 276M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 48900K .......... .......... .......... .......... .......... 66% 285M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 48950K .......... .......... .......... .......... .......... 66% 227M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 49000K .......... .......... .......... .......... .......... 66% 325M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 49050K .......... .......... .......... .......... .......... 66% 312M 0s 2019-11-27T13:08:50.192 INFO:teuthology.orchestra.run.smithi005.stderr: 49100K .......... .......... .......... .......... .......... 66% 334M 0s 2019-11-27T13:08:50.193 INFO:teuthology.orchestra.run.smithi005.stderr: 49150K .......... .......... .......... .......... .......... 66% 270M 0s 2019-11-27T13:08:50.193 INFO:teuthology.orchestra.run.smithi005.stderr: 49200K .......... .......... .......... .......... .......... 66% 329M 0s 2019-11-27T13:08:50.193 INFO:teuthology.orchestra.run.smithi005.stderr: 49250K .......... .......... .......... .......... .......... 67% 377M 0s 2019-11-27T13:08:50.193 INFO:teuthology.orchestra.run.smithi005.stderr: 49300K .......... .......... .......... .......... .......... 67% 328M 0s 2019-11-27T13:08:50.193 INFO:teuthology.orchestra.run.smithi005.stderr: 49350K .......... .......... .......... .......... .......... 67% 288M 0s 2019-11-27T13:08:50.193 INFO:teuthology.orchestra.run.smithi005.stderr: 49400K .......... .......... .......... .......... .......... 67% 313M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49450K .......... .......... .......... .......... .......... 67% 382M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49500K .......... .......... .......... .......... .......... 67% 280M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49550K .......... .......... .......... .......... .......... 67% 230M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49600K .......... .......... .......... .......... .......... 67% 294M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49650K .......... .......... .......... .......... .......... 67% 264M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49700K .......... .......... .......... .......... .......... 67% 228M 0s 2019-11-27T13:08:50.194 INFO:teuthology.orchestra.run.smithi005.stderr: 49750K .......... .......... .......... .......... .......... 67% 239M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 49800K .......... .......... .......... .......... .......... 67% 235M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 49850K .......... .......... .......... .......... .......... 67% 253M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 49900K .......... .......... .......... .......... .......... 67% 241M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 49950K .......... .......... .......... .......... .......... 67% 218M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 50000K .......... .......... .......... .......... .......... 68% 182M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 50050K .......... .......... .......... .......... .......... 68% 165M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 50100K .......... .......... .......... .......... .......... 68% 252M 0s 2019-11-27T13:08:50.195 INFO:teuthology.orchestra.run.smithi005.stderr: 50150K .......... .......... .......... .......... .......... 68% 155M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50200K .......... .......... .......... .......... .......... 68% 214M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50250K .......... .......... .......... .......... .......... 68% 240M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50300K .......... .......... .......... .......... .......... 68% 198M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50350K .......... .......... .......... .......... .......... 68% 206M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50400K .......... .......... .......... .......... .......... 68% 244M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50450K .......... .......... .......... .......... .......... 68% 210M 0s 2019-11-27T13:08:50.196 INFO:teuthology.orchestra.run.smithi005.stderr: 50500K .......... .......... .......... .......... .......... 68% 210M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50550K .......... .......... .......... .......... .......... 68% 197M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50600K .......... .......... .......... .......... .......... 68% 254M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50650K .......... .......... .......... .......... .......... 68% 230M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50700K .......... .......... .......... .......... .......... 68% 226M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50750K .......... .......... .......... .......... .......... 69% 202M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50800K .......... .......... .......... .......... .......... 69% 234M 0s 2019-11-27T13:08:50.197 INFO:teuthology.orchestra.run.smithi005.stderr: 50850K .......... .......... .......... .......... .......... 69% 250M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 50900K .......... .......... .......... .......... .......... 69% 225M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 50950K .......... .......... .......... .......... .......... 69% 211M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 51000K .......... .......... .......... .......... .......... 69% 237M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 51050K .......... .......... .......... .......... .......... 69% 243M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 51100K .......... .......... .......... .......... .......... 69% 228M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 51150K .......... .......... .......... .......... .......... 69% 196M 0s 2019-11-27T13:08:50.198 INFO:teuthology.orchestra.run.smithi005.stderr: 51200K .......... .......... .......... .......... .......... 69% 254M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51250K .......... .......... .......... .......... .......... 69% 238M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51300K .......... .......... .......... .......... .......... 69% 204M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51350K .......... .......... .......... .......... .......... 69% 196M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51400K .......... .......... .......... .......... .......... 69% 205M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51450K .......... .......... .......... .......... .......... 70% 205M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51500K .......... .......... .......... .......... .......... 70% 226M 0s 2019-11-27T13:08:50.199 INFO:teuthology.orchestra.run.smithi005.stderr: 51550K .......... .......... .......... .......... .......... 70% 211M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51600K .......... .......... .......... .......... .......... 70% 261M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51650K .......... .......... .......... .......... .......... 70% 260M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51700K .......... .......... .......... .......... .......... 70% 239M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51750K .......... .......... .......... .......... .......... 70% 234M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51800K .......... .......... .......... .......... .......... 70% 260M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51850K .......... .......... .......... .......... .......... 70% 242M 0s 2019-11-27T13:08:50.200 INFO:teuthology.orchestra.run.smithi005.stderr: 51900K .......... .......... .......... .......... .......... 70% 263M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 51950K .......... .......... .......... .......... .......... 70% 191M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 52000K .......... .......... .......... .......... .......... 70% 268M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 52050K .......... .......... .......... .......... .......... 70% 231M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 52100K .......... .......... .......... .......... .......... 70% 256M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 52150K .......... .......... .......... .......... .......... 70% 230M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 52200K .......... .......... .......... .......... .......... 71% 237M 0s 2019-11-27T13:08:50.201 INFO:teuthology.orchestra.run.smithi005.stderr: 52250K .......... .......... .......... .......... .......... 71% 250M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52300K .......... .......... .......... .......... .......... 71% 260M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52350K .......... .......... .......... .......... .......... 71% 208M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52400K .......... .......... .......... .......... .......... 71% 272M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52450K .......... .......... .......... .......... .......... 71% 236M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52500K .......... .......... .......... .......... .......... 71% 259M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52550K .......... .......... .......... .......... .......... 71% 212M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52600K .......... .......... .......... .......... .......... 71% 258M 0s 2019-11-27T13:08:50.202 INFO:teuthology.orchestra.run.smithi005.stderr: 52650K .......... .......... .......... .......... .......... 71% 245M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 52700K .......... .......... .......... .......... .......... 71% 249M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 52750K .......... .......... .......... .......... .......... 71% 230M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 52800K .......... .......... .......... .......... .......... 71% 225M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 52850K .......... .......... .......... .......... .......... 71% 248M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 52900K .......... .......... .......... .......... .......... 71% 245M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 52950K .......... .......... .......... .......... .......... 72% 218M 0s 2019-11-27T13:08:50.203 INFO:teuthology.orchestra.run.smithi005.stderr: 53000K .......... .......... .......... .......... .......... 72% 260M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53050K .......... .......... .......... .......... .......... 72% 219M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53100K .......... .......... .......... .......... .......... 72% 240M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53150K .......... .......... .......... .......... .......... 72% 198M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53200K .......... .......... .......... .......... .......... 72% 219M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53250K .......... .......... .......... .......... .......... 72% 245M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53300K .......... .......... .......... .......... .......... 72% 253M 0s 2019-11-27T13:08:50.204 INFO:teuthology.orchestra.run.smithi005.stderr: 53350K .......... .......... .......... .......... .......... 72% 246M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53400K .......... .......... .......... .......... .......... 72% 240M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53450K .......... .......... .......... .......... .......... 72% 274M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53500K .......... .......... .......... .......... .......... 72% 270M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53550K .......... .......... .......... .......... .......... 72% 196M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53600K .......... .......... .......... .......... .......... 72% 252M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53650K .......... .......... .......... .......... .......... 73% 239M 0s 2019-11-27T13:08:50.205 INFO:teuthology.orchestra.run.smithi005.stderr: 53700K .......... .......... .......... .......... .......... 73% 250M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 53750K .......... .......... .......... .......... .......... 73% 204M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 53800K .......... .......... .......... .......... .......... 73% 252M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 53850K .......... .......... .......... .......... .......... 73% 261M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 53900K .......... .......... .......... .......... .......... 73% 199M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 53950K .......... .......... .......... .......... .......... 73% 215M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 54000K .......... .......... .......... .......... .......... 73% 231M 0s 2019-11-27T13:08:50.206 INFO:teuthology.orchestra.run.smithi005.stderr: 54050K .......... .......... .......... .......... .......... 73% 226M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54100K .......... .......... .......... .......... .......... 73% 233M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54150K .......... .......... .......... .......... .......... 73% 218M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54200K .......... .......... .......... .......... .......... 73% 244M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54250K .......... .......... .......... .......... .......... 73% 222M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54300K .......... .......... .......... .......... .......... 73% 281M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54350K .......... .......... .......... .......... .......... 73% 197M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54400K .......... .......... .......... .......... .......... 74% 265M 0s 2019-11-27T13:08:50.207 INFO:teuthology.orchestra.run.smithi005.stderr: 54450K .......... .......... .......... .......... .......... 74% 297M 0s 2019-11-27T13:08:50.208 INFO:teuthology.orchestra.run.smithi005.stderr: 54500K .......... .......... .......... .......... .......... 74% 348M 0s 2019-11-27T13:08:50.208 INFO:teuthology.orchestra.run.smithi005.stderr: 54550K .......... .......... .......... .......... .......... 74% 334M 0s 2019-11-27T13:08:50.208 INFO:teuthology.orchestra.run.smithi005.stderr: 54600K .......... .......... .......... .......... .......... 74% 379M 0s 2019-11-27T13:08:50.208 INFO:teuthology.orchestra.run.smithi005.stderr: 54650K .......... .......... .......... .......... .......... 74% 337M 0s 2019-11-27T13:08:50.208 INFO:teuthology.orchestra.run.smithi005.stderr: 54700K .......... .......... .......... .......... .......... 74% 349M 0s 2019-11-27T13:08:50.208 INFO:teuthology.orchestra.run.smithi005.stderr: 54750K .......... .......... .......... .......... .......... 74% 329M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 54800K .......... .......... .......... .......... .......... 74% 366M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 54850K .......... .......... .......... .......... .......... 74% 316M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 54900K .......... .......... .......... .......... .......... 74% 366M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 54950K .......... .......... .......... .......... .......... 74% 309M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 55000K .......... .......... .......... .......... .......... 74% 346M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 55050K .......... .......... .......... .......... .......... 74% 374M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 55100K .......... .......... .......... .......... .......... 74% 355M 0s 2019-11-27T13:08:50.209 INFO:teuthology.orchestra.run.smithi005.stderr: 55150K .......... .......... .......... .......... .......... 75% 338M 0s 2019-11-27T13:08:50.210 INFO:teuthology.orchestra.run.smithi005.stderr: 55200K .......... .......... .......... .......... .......... 75% 350M 0s 2019-11-27T13:08:50.210 INFO:teuthology.orchestra.run.smithi005.stderr: 55250K .......... .......... .......... .......... .......... 75% 359M 0s 2019-11-27T13:08:50.210 INFO:teuthology.orchestra.run.smithi005.stderr: 55300K .......... .......... .......... .......... .......... 75% 347M 0s 2019-11-27T13:08:50.210 INFO:teuthology.orchestra.run.smithi005.stderr: 55350K .......... .......... .......... .......... .......... 75% 292M 0s 2019-11-27T13:08:50.210 INFO:teuthology.orchestra.run.smithi005.stderr: 55400K .......... .......... .......... .......... .......... 75% 379M 0s 2019-11-27T13:08:50.210 INFO:teuthology.orchestra.run.smithi005.stderr: 55450K .......... .......... .......... .......... .......... 75% 338M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55500K .......... .......... .......... .......... .......... 75% 366M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55550K .......... .......... .......... .......... .......... 75% 321M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55600K .......... .......... .......... .......... .......... 75% 379M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55650K .......... .......... .......... .......... .......... 75% 411M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55700K .......... .......... .......... .......... .......... 75% 367M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55750K .......... .......... .......... .......... .......... 75% 271M 0s 2019-11-27T13:08:50.211 INFO:teuthology.orchestra.run.smithi005.stderr: 55800K .......... .......... .......... .......... .......... 75% 341M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 55850K .......... .......... .......... .......... .......... 75% 352M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 55900K .......... .......... .......... .......... .......... 76% 326M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 55950K .......... .......... .......... .......... .......... 76% 342M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 56000K .......... .......... .......... .......... .......... 76% 373M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 56050K .......... .......... .......... .......... .......... 76% 320M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 56100K .......... .......... .......... .......... .......... 76% 312M 0s 2019-11-27T13:08:50.212 INFO:teuthology.orchestra.run.smithi005.stderr: 56150K .......... .......... .......... .......... .......... 76% 344M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56200K .......... .......... .......... .......... .......... 76% 401M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56250K .......... .......... .......... .......... .......... 76% 365M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56300K .......... .......... .......... .......... .......... 76% 303M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56350K .......... .......... .......... .......... .......... 76% 283M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56400K .......... .......... .......... .......... .......... 76% 299M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56450K .......... .......... .......... .......... .......... 76% 324M 0s 2019-11-27T13:08:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: 56500K .......... .......... .......... .......... .......... 76% 396M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56550K .......... .......... .......... .......... .......... 76% 306M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56600K .......... .......... .......... .......... .......... 77% 347M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56650K .......... .......... .......... .......... .......... 77% 325M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56700K .......... .......... .......... .......... .......... 77% 383M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56750K .......... .......... .......... .......... .......... 77% 263M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56800K .......... .......... .......... .......... .......... 77% 358M 0s 2019-11-27T13:08:50.214 INFO:teuthology.orchestra.run.smithi005.stderr: 56850K .......... .......... .......... .......... .......... 77% 349M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 56900K .......... .......... .......... .......... .......... 77% 356M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 56950K .......... .......... .......... .......... .......... 77% 332M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 57000K .......... .......... .......... .......... .......... 77% 353M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 57050K .......... .......... .......... .......... .......... 77% 342M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 57100K .......... .......... .......... .......... .......... 77% 353M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 57150K .......... .......... .......... .......... .......... 77% 263M 0s 2019-11-27T13:08:50.215 INFO:teuthology.orchestra.run.smithi005.stderr: 57200K .......... .......... .......... .......... .......... 77% 363M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57250K .......... .......... .......... .......... .......... 77% 357M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57300K .......... .......... .......... .......... .......... 77% 347M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57350K .......... .......... .......... .......... .......... 78% 282M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57400K .......... .......... .......... .......... .......... 78% 358M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57450K .......... .......... .......... .......... .......... 78% 365M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57500K .......... .......... .......... .......... .......... 78% 354M 0s 2019-11-27T13:08:50.216 INFO:teuthology.orchestra.run.smithi005.stderr: 57550K .......... .......... .......... .......... .......... 78% 303M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57600K .......... .......... .......... .......... .......... 78% 387M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57650K .......... .......... .......... .......... .......... 78% 371M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57700K .......... .......... .......... .......... .......... 78% 341M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57750K .......... .......... .......... .......... .......... 78% 316M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57800K .......... .......... .......... .......... .......... 78% 414M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57850K .......... .......... .......... .......... .......... 78% 425M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57900K .......... .......... .......... .......... .......... 78% 384M 0s 2019-11-27T13:08:50.217 INFO:teuthology.orchestra.run.smithi005.stderr: 57950K .......... .......... .......... .......... .......... 78% 291M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58000K .......... .......... .......... .......... .......... 78% 351M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58050K .......... .......... .......... .......... .......... 78% 361M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58100K .......... .......... .......... .......... .......... 79% 359M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58150K .......... .......... .......... .......... .......... 79% 279M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58200K .......... .......... .......... .......... .......... 79% 414M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58250K .......... .......... .......... .......... .......... 79% 426M 0s 2019-11-27T13:08:50.218 INFO:teuthology.orchestra.run.smithi005.stderr: 58300K .......... .......... .......... .......... .......... 79% 359M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58350K .......... .......... .......... .......... .......... 79% 257M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58400K .......... .......... .......... .......... .......... 79% 300M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58450K .......... .......... .......... .......... .......... 79% 343M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58500K .......... .......... .......... .......... .......... 79% 408M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58550K .......... .......... .......... .......... .......... 79% 284M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58600K .......... .......... .......... .......... .......... 79% 404M 0s 2019-11-27T13:08:50.219 INFO:teuthology.orchestra.run.smithi005.stderr: 58650K .......... .......... .......... .......... .......... 79% 336M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 58700K .......... .......... .......... .......... .......... 79% 311M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 58750K .......... .......... .......... .......... .......... 79% 287M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 58800K .......... .......... .......... .......... .......... 80% 392M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 58850K .......... .......... .......... .......... .......... 80% 379M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 58900K .......... .......... .......... .......... .......... 80% 328M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 58950K .......... .......... .......... .......... .......... 80% 326M 0s 2019-11-27T13:08:50.220 INFO:teuthology.orchestra.run.smithi005.stderr: 59000K .......... .......... .......... .......... .......... 80% 372M 0s 2019-11-27T13:08:50.221 INFO:teuthology.orchestra.run.smithi005.stderr: 59050K .......... .......... .......... .......... .......... 80% 335M 0s 2019-11-27T13:08:50.221 INFO:teuthology.orchestra.run.smithi005.stderr: 59100K .......... .......... .......... .......... .......... 80% 356M 0s 2019-11-27T13:08:50.221 INFO:teuthology.orchestra.run.smithi005.stderr: 59150K .......... .......... .......... .......... .......... 80% 318M 0s 2019-11-27T13:08:50.221 INFO:teuthology.orchestra.run.smithi005.stderr: 59200K .......... .......... .......... .......... .......... 80% 388M 0s 2019-11-27T13:08:50.221 INFO:teuthology.orchestra.run.smithi005.stderr: 59250K .......... .......... .......... .......... .......... 80% 327M 0s 2019-11-27T13:08:50.221 INFO:teuthology.orchestra.run.smithi005.stderr: 59300K .......... .......... .......... .......... .......... 80% 322M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59350K .......... .......... .......... .......... .......... 80% 364M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59400K .......... .......... .......... .......... .......... 80% 368M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59450K .......... .......... .......... .......... .......... 80% 258M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59500K .......... .......... .......... .......... .......... 80% 412M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59550K .......... .......... .......... .......... .......... 81% 211M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59600K .......... .......... .......... .......... .......... 81% 231M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59650K .......... .......... .......... .......... .......... 81% 259M 0s 2019-11-27T13:08:50.222 INFO:teuthology.orchestra.run.smithi005.stderr: 59700K .......... .......... .......... .......... .......... 81% 247M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 59750K .......... .......... .......... .......... .......... 81% 239M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 59800K .......... .......... .......... .......... .......... 81% 256M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 59850K .......... .......... .......... .......... .......... 81% 267M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 59900K .......... .......... .......... .......... .......... 81% 294M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 59950K .......... .......... .......... .......... .......... 81% 217M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 60000K .......... .......... .......... .......... .......... 81% 258M 0s 2019-11-27T13:08:50.223 INFO:teuthology.orchestra.run.smithi005.stderr: 60050K .......... .......... .......... .......... .......... 81% 259M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60100K .......... .......... .......... .......... .......... 81% 255M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60150K .......... .......... .......... .......... .......... 81% 244M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60200K .......... .......... .......... .......... .......... 81% 291M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60250K .......... .......... .......... .......... .......... 81% 285M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60300K .......... .......... .......... .......... .......... 82% 253M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60350K .......... .......... .......... .......... .......... 82% 226M 0s 2019-11-27T13:08:50.224 INFO:teuthology.orchestra.run.smithi005.stderr: 60400K .......... .......... .......... .......... .......... 82% 271M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60450K .......... .......... .......... .......... .......... 82% 267M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60500K .......... .......... .......... .......... .......... 82% 290M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60550K .......... .......... .......... .......... .......... 82% 243M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60600K .......... .......... .......... .......... .......... 82% 288M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60650K .......... .......... .......... .......... .......... 82% 274M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60700K .......... .......... .......... .......... .......... 82% 269M 0s 2019-11-27T13:08:50.225 INFO:teuthology.orchestra.run.smithi005.stderr: 60750K .......... .......... .......... .......... .......... 82% 210M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 60800K .......... .......... .......... .......... .......... 82% 236M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 60850K .......... .......... .......... .......... .......... 82% 282M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 60900K .......... .......... .......... .......... .......... 82% 296M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 60950K .......... .......... .......... .......... .......... 82% 224M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 61000K .......... .......... .......... .......... .......... 82% 206M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 61050K .......... .......... .......... .......... .......... 83% 209M 0s 2019-11-27T13:08:50.226 INFO:teuthology.orchestra.run.smithi005.stderr: 61100K .......... .......... .......... .......... .......... 83% 230M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61150K .......... .......... .......... .......... .......... 83% 212M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61200K .......... .......... .......... .......... .......... 83% 270M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61250K .......... .......... .......... .......... .......... 83% 269M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61300K .......... .......... .......... .......... .......... 83% 268M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61350K .......... .......... .......... .......... .......... 83% 233M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61400K .......... .......... .......... .......... .......... 83% 249M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61450K .......... .......... .......... .......... .......... 83% 299M 0s 2019-11-27T13:08:50.227 INFO:teuthology.orchestra.run.smithi005.stderr: 61500K .......... .......... .......... .......... .......... 83% 270M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61550K .......... .......... .......... .......... .......... 83% 216M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61600K .......... .......... .......... .......... .......... 83% 291M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61650K .......... .......... .......... .......... .......... 83% 281M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61700K .......... .......... .......... .......... .......... 83% 266M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61750K .......... .......... .......... .......... .......... 84% 251M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61800K .......... .......... .......... .......... .......... 84% 266M 0s 2019-11-27T13:08:50.228 INFO:teuthology.orchestra.run.smithi005.stderr: 61850K .......... .......... .......... .......... .......... 84% 270M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 61900K .......... .......... .......... .......... .......... 84% 261M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 61950K .......... .......... .......... .......... .......... 84% 219M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 62000K .......... .......... .......... .......... .......... 84% 273M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 62050K .......... .......... .......... .......... .......... 84% 283M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 62100K .......... .......... .......... .......... .......... 84% 274M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 62150K .......... .......... .......... .......... .......... 84% 240M 0s 2019-11-27T13:08:50.229 INFO:teuthology.orchestra.run.smithi005.stderr: 62200K .......... .......... .......... .......... .......... 84% 280M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62250K .......... .......... .......... .......... .......... 84% 276M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62300K .......... .......... .......... .......... .......... 84% 268M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62350K .......... .......... .......... .......... .......... 84% 219M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62400K .......... .......... .......... .......... .......... 84% 262M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62450K .......... .......... .......... .......... .......... 84% 263M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62500K .......... .......... .......... .......... .......... 85% 311M 0s 2019-11-27T13:08:50.230 INFO:teuthology.orchestra.run.smithi005.stderr: 62550K .......... .......... .......... .......... .......... 85% 346M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62600K .......... .......... .......... .......... .......... 85% 367M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62650K .......... .......... .......... .......... .......... 85% 337M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62700K .......... .......... .......... .......... .......... 85% 369M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62750K .......... .......... .......... .......... .......... 85% 288M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62800K .......... .......... .......... .......... .......... 85% 262M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62850K .......... .......... .......... .......... .......... 85% 280M 0s 2019-11-27T13:08:50.231 INFO:teuthology.orchestra.run.smithi005.stderr: 62900K .......... .......... .......... .......... .......... 85% 377M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 62950K .......... .......... .......... .......... .......... 85% 340M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 63000K .......... .......... .......... .......... .......... 85% 332M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 63050K .......... .......... .......... .......... .......... 85% 313M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 63100K .......... .......... .......... .......... .......... 85% 314M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 63150K .......... .......... .......... .......... .......... 85% 290M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 63200K .......... .......... .......... .......... .......... 85% 338M 0s 2019-11-27T13:08:50.232 INFO:teuthology.orchestra.run.smithi005.stderr: 63250K .......... .......... .......... .......... .......... 86% 347M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63300K .......... .......... .......... .......... .......... 86% 326M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63350K .......... .......... .......... .......... .......... 86% 324M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63400K .......... .......... .......... .......... .......... 86% 353M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63450K .......... .......... .......... .......... .......... 86% 353M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63500K .......... .......... .......... .......... .......... 86% 373M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63550K .......... .......... .......... .......... .......... 86% 312M 0s 2019-11-27T13:08:50.233 INFO:teuthology.orchestra.run.smithi005.stderr: 63600K .......... .......... .......... .......... .......... 86% 408M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63650K .......... .......... .......... .......... .......... 86% 327M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63700K .......... .......... .......... .......... .......... 86% 338M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63750K .......... .......... .......... .......... .......... 86% 330M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63800K .......... .......... .......... .......... .......... 86% 361M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63850K .......... .......... .......... .......... .......... 86% 353M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63900K .......... .......... .......... .......... .......... 86% 347M 0s 2019-11-27T13:08:50.234 INFO:teuthology.orchestra.run.smithi005.stderr: 63950K .......... .......... .......... .......... .......... 87% 301M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64000K .......... .......... .......... .......... .......... 87% 385M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64050K .......... .......... .......... .......... .......... 87% 354M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64100K .......... .......... .......... .......... .......... 87% 343M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64150K .......... .......... .......... .......... .......... 87% 328M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64200K .......... .......... .......... .......... .......... 87% 368M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64250K .......... .......... .......... .......... .......... 87% 341M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64300K .......... .......... .......... .......... .......... 87% 325M 0s 2019-11-27T13:08:50.235 INFO:teuthology.orchestra.run.smithi005.stderr: 64350K .......... .......... .......... .......... .......... 87% 280M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64400K .......... .......... .......... .......... .......... 87% 323M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64450K .......... .......... .......... .......... .......... 87% 404M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64500K .......... .......... .......... .......... .......... 87% 399M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64550K .......... .......... .......... .......... .......... 87% 323M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64600K .......... .......... .......... .......... .......... 87% 300M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64650K .......... .......... .......... .......... .......... 87% 346M 0s 2019-11-27T13:08:50.236 INFO:teuthology.orchestra.run.smithi005.stderr: 64700K .......... .......... .......... .......... .......... 88% 349M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 64750K .......... .......... .......... .......... .......... 88% 260M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 64800K .......... .......... .......... .......... .......... 88% 359M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 64850K .......... .......... .......... .......... .......... 88% 420M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 64900K .......... .......... .......... .......... .......... 88% 315M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 64950K .......... .......... .......... .......... .......... 88% 310M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 65000K .......... .......... .......... .......... .......... 88% 346M 0s 2019-11-27T13:08:50.237 INFO:teuthology.orchestra.run.smithi005.stderr: 65050K .......... .......... .......... .......... .......... 88% 428M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65100K .......... .......... .......... .......... .......... 88% 412M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65150K .......... .......... .......... .......... .......... 88% 307M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65200K .......... .......... .......... .......... .......... 88% 333M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65250K .......... .......... .......... .......... .......... 88% 342M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65300K .......... .......... .......... .......... .......... 88% 379M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65350K .......... .......... .......... .......... .......... 88% 258M 0s 2019-11-27T13:08:50.238 INFO:teuthology.orchestra.run.smithi005.stderr: 65400K .......... .......... .......... .......... .......... 88% 298M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65450K .......... .......... .......... .......... .......... 89% 272M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65500K .......... .......... .......... .......... .......... 89% 319M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65550K .......... .......... .......... .......... .......... 89% 335M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65600K .......... .......... .......... .......... .......... 89% 330M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65650K .......... .......... .......... .......... .......... 89% 348M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65700K .......... .......... .......... .......... .......... 89% 356M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65750K .......... .......... .......... .......... .......... 89% 294M 0s 2019-11-27T13:08:50.239 INFO:teuthology.orchestra.run.smithi005.stderr: 65800K .......... .......... .......... .......... .......... 89% 386M 0s 2019-11-27T13:08:50.240 INFO:teuthology.orchestra.run.smithi005.stderr: 65850K .......... .......... .......... .......... .......... 89% 402M 0s 2019-11-27T13:08:50.240 INFO:teuthology.orchestra.run.smithi005.stderr: 65900K .......... .......... .......... .......... .......... 89% 361M 0s 2019-11-27T13:08:50.240 INFO:teuthology.orchestra.run.smithi005.stderr: 65950K .......... .......... .......... .......... .......... 89% 347M 0s 2019-11-27T13:08:50.240 INFO:teuthology.orchestra.run.smithi005.stderr: 66000K .......... .......... .......... .......... .......... 89% 398M 0s 2019-11-27T13:08:50.240 INFO:teuthology.orchestra.run.smithi005.stderr: 66050K .......... .......... .......... .......... .......... 89% 276M 0s 2019-11-27T13:08:50.240 INFO:teuthology.orchestra.run.smithi005.stderr: 66100K .......... .......... .......... .......... .......... 89% 288M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66150K .......... .......... .......... .......... .......... 89% 296M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66200K .......... .......... .......... .......... .......... 90% 357M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66250K .......... .......... .......... .......... .......... 90% 385M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66300K .......... .......... .......... .......... .......... 90% 348M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66350K .......... .......... .......... .......... .......... 90% 302M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66400K .......... .......... .......... .......... .......... 90% 389M 0s 2019-11-27T13:08:50.241 INFO:teuthology.orchestra.run.smithi005.stderr: 66450K .......... .......... .......... .......... .......... 90% 364M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66500K .......... .......... .......... .......... .......... 90% 402M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66550K .......... .......... .......... .......... .......... 90% 323M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66600K .......... .......... .......... .......... .......... 90% 387M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66650K .......... .......... .......... .......... .......... 90% 425M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66700K .......... .......... .......... .......... .......... 90% 394M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66750K .......... .......... .......... .......... .......... 90% 300M 0s 2019-11-27T13:08:50.242 INFO:teuthology.orchestra.run.smithi005.stderr: 66800K .......... .......... .......... .......... .......... 90% 362M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 66850K .......... .......... .......... .......... .......... 90% 347M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 66900K .......... .......... .......... .......... .......... 91% 411M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 66950K .......... .......... .......... .......... .......... 91% 321M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 67000K .......... .......... .......... .......... .......... 91% 383M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 67050K .......... .......... .......... .......... .......... 91% 393M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 67100K .......... .......... .......... .......... .......... 91% 428M 0s 2019-11-27T13:08:50.243 INFO:teuthology.orchestra.run.smithi005.stderr: 67150K .......... .......... .......... .......... .......... 91% 356M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67200K .......... .......... .......... .......... .......... 91% 390M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67250K .......... .......... .......... .......... .......... 91% 346M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67300K .......... .......... .......... .......... .......... 91% 380M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67350K .......... .......... .......... .......... .......... 91% 327M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67400K .......... .......... .......... .......... .......... 91% 384M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67450K .......... .......... .......... .......... .......... 91% 376M 0s 2019-11-27T13:08:50.244 INFO:teuthology.orchestra.run.smithi005.stderr: 67500K .......... .......... .......... .......... .......... 91% 353M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67550K .......... .......... .......... .......... .......... 91% 326M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67600K .......... .......... .......... .......... .......... 91% 368M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67650K .......... .......... .......... .......... .......... 92% 414M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67700K .......... .......... .......... .......... .......... 92% 357M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67750K .......... .......... .......... .......... .......... 92% 273M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67800K .......... .......... .......... .......... .......... 92% 287M 0s 2019-11-27T13:08:50.245 INFO:teuthology.orchestra.run.smithi005.stderr: 67850K .......... .......... .......... .......... .......... 92% 335M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 67900K .......... .......... .......... .......... .......... 92% 329M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 67950K .......... .......... .......... .......... .......... 92% 247M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 68000K .......... .......... .......... .......... .......... 92% 397M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 68050K .......... .......... .......... .......... .......... 92% 314M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 68100K .......... .......... .......... .......... .......... 92% 338M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 68150K .......... .......... .......... .......... .......... 92% 312M 0s 2019-11-27T13:08:50.246 INFO:teuthology.orchestra.run.smithi005.stderr: 68200K .......... .......... .......... .......... .......... 92% 406M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68250K .......... .......... .......... .......... .......... 92% 344M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68300K .......... .......... .......... .......... .......... 92% 335M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68350K .......... .......... .......... .......... .......... 92% 287M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68400K .......... .......... .......... .......... .......... 93% 279M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68450K .......... .......... .......... .......... .......... 93% 321M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68500K .......... .......... .......... .......... .......... 93% 367M 0s 2019-11-27T13:08:50.247 INFO:teuthology.orchestra.run.smithi005.stderr: 68550K .......... .......... .......... .......... .......... 93% 321M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68600K .......... .......... .......... .......... .......... 93% 388M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68650K .......... .......... .......... .......... .......... 93% 383M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68700K .......... .......... .......... .......... .......... 93% 341M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68750K .......... .......... .......... .......... .......... 93% 353M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68800K .......... .......... .......... .......... .......... 93% 424M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68850K .......... .......... .......... .......... .......... 93% 407M 0s 2019-11-27T13:08:50.248 INFO:teuthology.orchestra.run.smithi005.stderr: 68900K .......... .......... .......... .......... .......... 93% 360M 0s 2019-11-27T13:08:50.249 INFO:teuthology.orchestra.run.smithi005.stderr: 68950K .......... .......... .......... .......... .......... 93% 286M 0s 2019-11-27T13:08:50.249 INFO:teuthology.orchestra.run.smithi005.stderr: 69000K .......... .......... .......... .......... .......... 93% 371M 0s 2019-11-27T13:08:50.249 INFO:teuthology.orchestra.run.smithi005.stderr: 69050K .......... .......... .......... .......... .......... 93% 360M 0s 2019-11-27T13:08:50.249 INFO:teuthology.orchestra.run.smithi005.stderr: 69100K .......... .......... .......... .......... .......... 94% 400M 0s 2019-11-27T13:08:50.249 INFO:teuthology.orchestra.run.smithi005.stderr: 69150K .......... .......... .......... .......... .......... 94% 305M 0s 2019-11-27T13:08:50.249 INFO:teuthology.orchestra.run.smithi005.stderr: 69200K .......... .......... .......... .......... .......... 94% 329M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69250K .......... .......... .......... .......... .......... 94% 369M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69300K .......... .......... .......... .......... .......... 94% 363M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69350K .......... .......... .......... .......... .......... 94% 359M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69400K .......... .......... .......... .......... .......... 94% 368M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69450K .......... .......... .......... .......... .......... 94% 337M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69500K .......... .......... .......... .......... .......... 94% 360M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69550K .......... .......... .......... .......... .......... 94% 299M 0s 2019-11-27T13:08:50.250 INFO:teuthology.orchestra.run.smithi005.stderr: 69600K .......... .......... .......... .......... .......... 94% 365M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69650K .......... .......... .......... .......... .......... 94% 303M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69700K .......... .......... .......... .......... .......... 94% 383M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69750K .......... .......... .......... .......... .......... 94% 381M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69800K .......... .......... .......... .......... .......... 94% 426M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69850K .......... .......... .......... .......... .......... 95% 437M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69900K .......... .......... .......... .......... .......... 95% 310M 0s 2019-11-27T13:08:50.251 INFO:teuthology.orchestra.run.smithi005.stderr: 69950K .......... .......... .......... .......... .......... 95% 285M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70000K .......... .......... .......... .......... .......... 95% 337M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70050K .......... .......... .......... .......... .......... 95% 269M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70100K .......... .......... .......... .......... .......... 95% 320M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70150K .......... .......... .......... .......... .......... 95% 298M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70200K .......... .......... .......... .......... .......... 95% 355M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70250K .......... .......... .......... .......... .......... 95% 350M 0s 2019-11-27T13:08:50.252 INFO:teuthology.orchestra.run.smithi005.stderr: 70300K .......... .......... .......... .......... .......... 95% 319M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70350K .......... .......... .......... .......... .......... 95% 329M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70400K .......... .......... .......... .......... .......... 95% 403M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70450K .......... .......... .......... .......... .......... 95% 425M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70500K .......... .......... .......... .......... .......... 95% 281M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70550K .......... .......... .......... .......... .......... 95% 247M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70600K .......... .......... .......... .......... .......... 96% 342M 0s 2019-11-27T13:08:50.253 INFO:teuthology.orchestra.run.smithi005.stderr: 70650K .......... .......... .......... .......... .......... 96% 337M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 70700K .......... .......... .......... .......... .......... 96% 339M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 70750K .......... .......... .......... .......... .......... 96% 286M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 70800K .......... .......... .......... .......... .......... 96% 367M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 70850K .......... .......... .......... .......... .......... 96% 386M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 70900K .......... .......... .......... .......... .......... 96% 358M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 70950K .......... .......... .......... .......... .......... 96% 317M 0s 2019-11-27T13:08:50.254 INFO:teuthology.orchestra.run.smithi005.stderr: 71000K .......... .......... .......... .......... .......... 96% 320M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71050K .......... .......... .......... .......... .......... 96% 407M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71100K .......... .......... .......... .......... .......... 96% 344M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71150K .......... .......... .......... .......... .......... 96% 310M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71200K .......... .......... .......... .......... .......... 96% 371M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71250K .......... .......... .......... .......... .......... 96% 411M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71300K .......... .......... .......... .......... .......... 96% 364M 0s 2019-11-27T13:08:50.255 INFO:teuthology.orchestra.run.smithi005.stderr: 71350K .......... .......... .......... .......... .......... 97% 287M 0s 2019-11-27T13:08:50.256 INFO:teuthology.orchestra.run.smithi005.stderr: 71400K .......... .......... .......... .......... .......... 97% 363M 0s 2019-11-27T13:08:50.256 INFO:teuthology.orchestra.run.smithi005.stderr: 71450K .......... .......... .......... .......... .......... 97% 422M 0s 2019-11-27T13:08:50.256 INFO:teuthology.orchestra.run.smithi005.stderr: 71500K .......... .......... .......... .......... .......... 97% 412M 0s 2019-11-27T13:08:50.256 INFO:teuthology.orchestra.run.smithi005.stderr: 71550K .......... .......... .......... .......... .......... 97% 315M 0s 2019-11-27T13:08:50.256 INFO:teuthology.orchestra.run.smithi005.stderr: 71600K .......... .......... .......... .......... .......... 97% 355M 0s 2019-11-27T13:08:50.256 INFO:teuthology.orchestra.run.smithi005.stderr: 71650K .......... .......... .......... .......... .......... 97% 357M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 71700K .......... .......... .......... .......... .......... 97% 341M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 71750K .......... .......... .......... .......... .......... 97% 295M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 71800K .......... .......... .......... .......... .......... 97% 265M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 71850K .......... .......... .......... .......... .......... 97% 335M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 71900K .......... .......... .......... .......... .......... 97% 344M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 71950K .......... .......... .......... .......... .......... 97% 345M 0s 2019-11-27T13:08:50.257 INFO:teuthology.orchestra.run.smithi005.stderr: 72000K .......... .......... .......... .......... .......... 97% 333M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72050K .......... .......... .......... .......... .......... 98% 391M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72100K .......... .......... .......... .......... .......... 98% 349M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72150K .......... .......... .......... .......... .......... 98% 280M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72200K .......... .......... .......... .......... .......... 98% 414M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72250K .......... .......... .......... .......... .......... 98% 391M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72300K .......... .......... .......... .......... .......... 98% 347M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72350K .......... .......... .......... .......... .......... 98% 327M 0s 2019-11-27T13:08:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 72400K .......... .......... .......... .......... .......... 98% 419M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72450K .......... .......... .......... .......... .......... 98% 410M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72500K .......... .......... .......... .......... .......... 98% 341M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72550K .......... .......... .......... .......... .......... 98% 309M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72600K .......... .......... .......... .......... .......... 98% 304M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72650K .......... .......... .......... .......... .......... 98% 371M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72700K .......... .......... .......... .......... .......... 98% 315M 0s 2019-11-27T13:08:50.259 INFO:teuthology.orchestra.run.smithi005.stderr: 72750K .......... .......... .......... .......... .......... 98% 287M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 72800K .......... .......... .......... .......... .......... 99% 345M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 72850K .......... .......... .......... .......... .......... 99% 363M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 72900K .......... .......... .......... .......... .......... 99% 273M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 72950K .......... .......... .......... .......... .......... 99% 260M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 73000K .......... .......... .......... .......... .......... 99% 389M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 73050K .......... .......... .......... .......... .......... 99% 433M 0s 2019-11-27T13:08:50.260 INFO:teuthology.orchestra.run.smithi005.stderr: 73100K .......... .......... .......... .......... .......... 99% 360M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73150K .......... .......... .......... .......... .......... 99% 362M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73200K .......... .......... .......... .......... .......... 99% 425M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73250K .......... .......... .......... .......... .......... 99% 420M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73300K .......... .......... .......... .......... .......... 99% 416M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73350K .......... .......... .......... .......... .......... 99% 355M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73400K .......... .......... .......... .......... .......... 99% 413M 0s 2019-11-27T13:08:50.261 INFO:teuthology.orchestra.run.smithi005.stderr: 73450K .......... .......... .......... .......... .......... 99% 430M 0s 2019-11-27T13:08:50.262 INFO:teuthology.orchestra.run.smithi005.stderr: 73500K .......... .......... .......... .......... .......... 99% 428M 0s 2019-11-27T13:08:50.262 INFO:teuthology.orchestra.run.smithi005.stderr: 73550K ........ 100% 480M=0.3s 2019-11-27T13:08:50.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T13:08:50.262 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27 13:08:49 (230 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-11-27T13:08:50.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T13:08:50.262 INFO:teuthology.orchestra.run.smithi005.stdout:Archive: gradle-4.7-bin.zip 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: creating: /opt/gradle/gradle-4.7/ 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-11-27T13:08:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-11-27T13:08:50.264 INFO:teuthology.orchestra.run.smithi005.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-11-27T13:08:50.265 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-11-27T13:08:50.266 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-11-27T13:08:50.267 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-11-27T13:08:50.268 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-11-27T13:08:50.269 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-11-27T13:08:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-11-27T13:08:50.271 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-11-27T13:08:50.271 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-11-27T13:08:50.271 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-11-27T13:08:50.271 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-11-27T13:08:50.271 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-11-27T13:08:50.271 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-11-27T13:08:50.272 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-11-27T13:08:50.273 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-11-27T13:08:50.274 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-11-27T13:08:50.275 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-11-27T13:08:50.276 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-11-27T13:08:50.277 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-11-27T13:08:50.279 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-11-27T13:08:50.279 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-11-27T13:08:50.279 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-11-27T13:08:50.280 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-11-27T13:08:50.281 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-11-27T13:08:50.282 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-11-27T13:08:50.283 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-11-27T13:08:50.283 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-11-27T13:08:50.283 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-11-27T13:08:50.283 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-11-27T13:08:50.283 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-11-27T13:08:50.283 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-11-27T13:08:50.284 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-11-27T13:08:50.285 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-11-27T13:08:50.286 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-11-27T13:08:50.287 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-11-27T13:08:50.288 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-11-27T13:08:50.288 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-11-27T13:08:50.288 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-11-27T13:08:50.288 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-11-27T13:08:50.288 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-11-27T13:08:50.288 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-11-27T13:08:50.289 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-11-27T13:08:50.290 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-11-27T13:08:50.291 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-11-27T13:08:50.292 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-11-27T13:08:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-11-27T13:08:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-11-27T13:08:50.295 INFO:teuthology.orchestra.run.smithi005.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-11-27T13:08:50.295 INFO:teuthology.orchestra.run.smithi005.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-11-27T13:08:51.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.074 INFO:teuthology.orchestra.run.smithi005.stdout:Welcome to Gradle 4.7! 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout:Here are the highlights of this release: 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout: - Incremental annotation processing 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout: - JDK 10 support 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout: - Grouped non-interactive console logs 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout: - Failed tests are re-run first for quicker feedback 2019-11-27T13:08:51.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.076 INFO:teuthology.orchestra.run.smithi005.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-11-27T13:08:51.076 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.365 INFO:teuthology.orchestra.run.smithi005.stdout:------------------------------------------------------------ 2019-11-27T13:08:51.365 INFO:teuthology.orchestra.run.smithi005.stdout:Gradle 4.7 2019-11-27T13:08:51.365 INFO:teuthology.orchestra.run.smithi005.stdout:------------------------------------------------------------ 2019-11-27T13:08:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:Groovy: 2.4.12 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-11-27T13:08:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:OS: Linux 3.10.0-1062.4.3.el7.x86_64 amd64 2019-11-27T13:08:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:51.374 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-11-27T13:08:51.374 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-27T13:08:51.374 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi115.front.sepia.ceph.com 2019-11-27T13:08:51.374 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-27T13:08:51.374 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi005.front.sepia.ceph.com 2019-11-27T13:08:51.375 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-11-27T13:08:51.787 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-11-27T13:08:51.788 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-11-27T13:08:51.788 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'CQXPDQAJRICZZWQHWXLE', 's3dir': 'folder', 'endpoint': 'smithi005.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': '1ktC1xEd0IH4jHn8v7cw5/XRNE6D1AlYBimgkdaxGkUcRuALrwZnEw==', 'host': 'smithi005.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-11-27T13:08:51.788 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-11-27T13:08:51.788 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'CQXPDQAJRICZZWQHWXLE', '--secret', '1ktC1xEd0IH4jHn8v7cw5/XRNE6D1AlYBimgkdaxGkUcRuALrwZnEw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-11-27T13:08:51.789 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key CQXPDQAJRICZZWQHWXLE --secret 1ktC1xEd0IH4jHn8v7cw5/XRNE6D1AlYBimgkdaxGkUcRuALrwZnEw== --email tester.client.0_test@test.test --cluster ceph 2019-11-27T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.860+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.889+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.889+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.900+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.900+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:51.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.909+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:51.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.909+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:51.934+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.168+0000 7feb6b29aec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:08:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.168+0000 7feb6b29aec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:08:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.168+0000 7feb6b29aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:08:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.168+0000 7feb6b29aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:08:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.168+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.186+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.186+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.203+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.203+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.221+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:52.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.221+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.240+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.240+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.251+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.251+0000 7feb6b29aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:08:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.251+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.263+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:52.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.263+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.277+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:52.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.277+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.297+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.297+0000 7feb6b29aec0 20 zonegroup default 2019-11-27T13:08:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.297+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.307+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.307+0000 7feb6b29aec0 10 Cannot find current period zone using local zone 2019-11-27T13:08:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.307+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.317+0000 7feb6b29aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.317+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.332+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.332+0000 7feb6b29aec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.349+0000 7feb6b29aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.349+0000 7feb6b29aec0 20 zone default found 2019-11-27T13:08:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.349+0000 7feb6b29aec0 20 started sync module instance, tier type = 2019-11-27T13:08:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.349+0000 7feb6b29aec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:08:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=0 2019-11-27T13:08:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=1 2019-11-27T13:08:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=2 2019-11-27T13:08:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=3 2019-11-27T13:08:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=4 2019-11-27T13:08:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=5 2019-11-27T13:08:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.759+0000 7feb6b29aec0 20 add_watcher() i=6 2019-11-27T13:08:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.787+0000 7feb6b29aec0 20 add_watcher() i=7 2019-11-27T13:08:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.787+0000 7feb6b29aec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:08:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.787+0000 7feb28fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:08:52.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.795+0000 7feb58cc8700 0 -- 172.21.15.5:0/3194800799 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55e632f48d90 msgr2=0x55e632f491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T13:08:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:52.834+0000 7feb58cc8700 0 -- 172.21.15.5:0/2169131834 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7fea9c017570 msgr2=0x7fea9c019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.443+0000 7fea9affd700 20 reqs_thread_entry: start 2019-11-27T13:08:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.444+0000 7fea98ff9700 20 reqs_thread_entry: start 2019-11-27T13:08:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.444+0000 7feb6b29aec0 20 init_complete bucket index max shards: 0 2019-11-27T13:08:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.444+0000 7fea8effd700 20 reqs_thread_entry: start 2019-11-27T13:08:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.444+0000 7feb6b29aec0 20 get_system_obj_state: rctx=0x7ffe8165ed18 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55e632fcac70 s->prefetch_data=0 2019-11-27T13:08:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.444+0000 7feb6b29aec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-11-27T13:08:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.454+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-11-27T13:08:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.454+0000 7feb6b29aec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-27T13:08:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.454+0000 7feb6b29aec0 20 get_system_obj_state: rctx=0x7ffe8165ed28 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55e632fcca00 s->prefetch_data=0 2019-11-27T13:08:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.454+0000 7feb6b29aec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-11-27T13:08:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.463+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-11-27T13:08:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.463+0000 7feb6b29aec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-27T13:08:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.463+0000 7feb6b29aec0 20 get_system_obj_state: rctx=0x7ffe8165ed28 obj=default.rgw.meta:users.keys:CQXPDQAJRICZZWQHWXLE state=0x55e632fcca00 s->prefetch_data=0 2019-11-27T13:08:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.463+0000 7feb6b29aec0 10 cache get: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE : miss 2019-11-27T13:08:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.472+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE info.flags=0x0 2019-11-27T13:08:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.472+0000 7feb6b29aec0 10 adding default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE to cache LRU end 2019-11-27T13:08:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.473+0000 7feb6b29aec0 20 get_system_obj_state: rctx=0x7ffe8165e938 obj=default.rgw.meta:users.keys:CQXPDQAJRICZZWQHWXLE state=0x55e632fcca00 s->prefetch_data=0 2019-11-27T13:08:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.473+0000 7feb6b29aec0 10 cache get: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE : type miss (requested=0x6, cached=0x0) 2019-11-27T13:08:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.481+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE info.flags=0x0 2019-11-27T13:08:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.481+0000 7feb6b29aec0 10 moving default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE to cache LRU end 2019-11-27T13:08:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.481+0000 7feb6b29aec0 20 get_system_obj_state: rctx=0x7ffe8165eab8 obj=default.rgw.meta:users.keys:CQXPDQAJRICZZWQHWXLE state=0x55e632fcca00 s->prefetch_data=0 2019-11-27T13:08:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.481+0000 7feb6b29aec0 10 cache get: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE : type miss (requested=0x6, cached=0x0) 2019-11-27T13:08:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.490+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE info.flags=0x0 2019-11-27T13:08:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.490+0000 7feb6b29aec0 10 moving default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE to cache LRU end 2019-11-27T13:08:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.564+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-27T13:08:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.564+0000 7feb6b29aec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-27T13:08:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.564+0000 7feb6b29aec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-11-27T13:08:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.584+0000 7feb4dffb700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94447185674096 notifier 4481 bl.length()=632 2019-11-27T13:08:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.584+0000 7feb4dffb700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-27T13:08:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.584+0000 7feb4dffb700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-27T13:08:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.751+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-27T13:08:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.751+0000 7feb6b29aec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-27T13:08:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.751+0000 7feb6b29aec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-11-27T13:08:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.764+0000 7feb4dffb700 10 RGWWatcher::handle_notify() notify_id 579820584966 cookie 94447185668320 notifier 4481 bl.length()=200 2019-11-27T13:08:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.764+0000 7feb4dffb700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-27T13:08:54.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.764+0000 7feb4dffb700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-27T13:08:54.899 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.827+0000 7feb6b29aec0 10 cache put: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE info.flags=0x7 2019-11-27T13:08:54.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.827+0000 7feb6b29aec0 10 moving default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE to cache LRU end 2019-11-27T13:08:54.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.827+0000 7feb6b29aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=189 2019-11-27T13:08:54.913 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.841+0000 7feb4dffb700 10 RGWWatcher::handle_notify() notify_id 579820584975 cookie 94447185666240 notifier 4481 bl.length()=189 2019-11-27T13:08:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.841+0000 7feb4dffb700 10 cache put: name=default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE info.flags=0x7 2019-11-27T13:08:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:54.841+0000 7feb4dffb700 10 moving default.rgw.meta+users.keys+CQXPDQAJRICZZWQHWXLE to cache LRU end 2019-11-27T13:08:55.227 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T13:08:55.228 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "tester.client.0", 2019-11-27T13:08:55.228 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Ms. tester.client.0", 2019-11-27T13:08:55.228 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "tester.client.0_test@test.test", 2019-11-27T13:08:55.228 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T13:08:55.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [], 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [ 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "tester.client.0", 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "CQXPDQAJRICZZWQHWXLE", 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "1ktC1xEd0IH4jHn8v7cw5/XRNE6D1AlYBimgkdaxGkUcRuALrwZnEw==" 2019-11-27T13:08:55.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [], 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T13:08:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T13:08:55.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T13:08:55.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T13:08:55.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T13:08:55.233 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T13:08:55.233 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:08:55.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.213+0000 7feb6b29aec0 20 remove_watcher() i=0 2019-11-27T13:08:55.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.213+0000 7feb6b29aec0 2 removed watcher, disabling cache 2019-11-27T13:08:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.286+0000 7feb6b29aec0 20 remove_watcher() i=1 2019-11-27T13:08:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.343+0000 7feb6b29aec0 20 remove_watcher() i=2 2019-11-27T13:08:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.394+0000 7feb6b29aec0 20 remove_watcher() i=3 2019-11-27T13:08:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.425+0000 7feb6b29aec0 20 remove_watcher() i=4 2019-11-27T13:08:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.457+0000 7feb6b29aec0 20 remove_watcher() i=5 2019-11-27T13:08:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.523+0000 7feb6b29aec0 20 remove_watcher() i=6 2019-11-27T13:08:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.565+0000 7feb6b29aec0 20 remove_watcher() i=7 2019-11-27T13:08:55.648 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-11-27T13:08:55.703 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-11-27T13:08:55.704 INFO:teuthology.orchestra.run.smithi005:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-11-27T13:08:55.851 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:08:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.894+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.927+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.927+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.938+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.938+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.017 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.946+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:56.017 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.946+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:55.972+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.184+0000 7fe9da759ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:08:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.184+0000 7fe9da759ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:08:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.184+0000 7fe9da759ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:08:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.184+0000 7fe9da759ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:08:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.184+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.195+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.196+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.208+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.209+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.219+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.220+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.238+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.238+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.248+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.248+0000 7fe9da759ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:08:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.248+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.255+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.255+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.268+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.268+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.281+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:08:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.281+0000 7fe9da759ec0 20 zonegroup default 2019-11-27T13:08:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.281+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.288+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.288+0000 7fe9da759ec0 10 Cannot find current period zone using local zone 2019-11-27T13:08:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.288+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.295+0000 7fe9da759ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:08:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.295+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.307+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:08:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.307+0000 7fe9da759ec0 20 rados->read ofs=0 len=0 2019-11-27T13:08:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.315+0000 7fe9da759ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:08:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.315+0000 7fe9da759ec0 20 zone default found 2019-11-27T13:08:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.315+0000 7fe9da759ec0 20 started sync module instance, tier type = 2019-11-27T13:08:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.315+0000 7fe9da759ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:08:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=0 2019-11-27T13:08:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=1 2019-11-27T13:08:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=2 2019-11-27T13:08:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=3 2019-11-27T13:08:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=4 2019-11-27T13:08:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=5 2019-11-27T13:08:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.666+0000 7fe9da759ec0 20 add_watcher() i=6 2019-11-27T13:08:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.702+0000 7fe9da759ec0 20 add_watcher() i=7 2019-11-27T13:08:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.702+0000 7fe9da759ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:08:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.703+0000 7fe91bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:08:56.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.716+0000 7fe9c8187700 0 -- 172.21.15.5:0/2731725221 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x561309a89340 msgr2=0x561309a9d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:56.815 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:56.744+0000 7fe9c8187700 0 -- 172.21.15.5:0/442274528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x561309a86530 msgr2=0x561309a858c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:08:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.363+0000 7fe9067fc700 20 reqs_thread_entry: start 2019-11-27T13:08:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.364+0000 7fe8fffff700 20 reqs_thread_entry: start 2019-11-27T13:08:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.364+0000 7fe9da759ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:08:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.365+0000 7fe8fe7fc700 20 reqs_thread_entry: start 2019-11-27T13:08:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.365+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:08:58.530 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.458+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.491+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:08:58.580 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.509+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.572+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:08:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.659+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.687+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:08:58.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.703+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.748+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:08:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.809+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.837+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:08:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.854+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.900+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:08:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.966+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:59.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:58.991+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:08:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.032+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:08:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.032+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_KZB5AJfYxqIpJesGLlCu18POHXBZKh9', time=2019-11-27T15:08:25.464228+0000, chain.objs.size()=3 2019-11-27T13:08:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.032+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.HvuSGqcoKUF5J8IkNfLfaw2E5P2NAYR_0 2019-11-27T13:08:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.032+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.HvuSGqcoKUF5J8IkNfLfaw2E5P2NAYR_1 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.032+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.HvuSGqcoKUF5J8IkNfLfaw2E5P2NAYR_2 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.033+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.210', time=2019-11-27T15:08:29.064366+0000, chain.objs.size()=5 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.033+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-STANDARD.2~S3CnNlYlDBzd--NqP0vL57sK6BHbKi7.1 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.033+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__shadow_foo-STANDARD.2~S3CnNlYlDBzd--NqP0vL57sK6BHbKi7.1_1 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.033+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-STANDARD.2~S3CnNlYlDBzd--NqP0vL57sK6BHbKi7.2 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.033+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__shadow_foo-STANDARD.2~S3CnNlYlDBzd--NqP0vL57sK6BHbKi7.2_1 2019-11-27T13:08:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.033+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-STANDARD.2~S3CnNlYlDBzd--NqP0vL57sK6BHbKi7.3 2019-11-27T13:08:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.219+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:08:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.359+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:08:59.512 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.441+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:59.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.464+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:08:59.583 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-11-27T13:08:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.112', time=2019-11-27T15:08:21.443914+0000, chain.objs.size()=2 2019-11-27T13:08:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.tnGwqqAjU5vGdSqqL09cxhIyEguJ7h0_0 2019-11-27T13:08:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.tnGwqqAjU5vGdSqqL09cxhIyEguJ7h0_1 2019-11-27T13:08:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.114', time=2019-11-27T15:08:21.917214+0000, chain.objs.size()=2 2019-11-27T13:08:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.tnGwqqAjU5vGdSqqL09cxhIyEguJ7h0_0 2019-11-27T13:08:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.tnGwqqAjU5vGdSqqL09cxhIyEguJ7h0_1 2019-11-27T13:08:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_-46k9KmEpBchVCyHnvYO3mGvMFskHvC', time=2019-11-27T15:08:22.730548+0000, chain.objs.size()=1 2019-11-27T13:08:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.PVkqRrsQN5aMZyWqKRnRsRPGt96Vn1-_0 2019-11-27T13:08:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.85', time=2019-11-27T15:08:30.632483+0000, chain.objs.size()=3 2019-11-27T13:08:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6__shadow_.4bddXCu1CSQWMRuD9IGcGtJc6yqvANY_0 2019-11-27T13:08:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6__shadow_.4bddXCu1CSQWMRuD9IGcGtJc6yqvANY_1 2019-11-27T13:08:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.511+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6__shadow_.4bddXCu1CSQWMRuD9IGcGtJc6yqvANY_2 2019-11-27T13:08:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.646+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:08:59.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.768+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:08:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.837+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.864+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:08:59.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.875+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:08:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.920+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:09:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:08:59.986+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:00.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.002+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.012+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:00.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.058+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:09:00.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.143+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:00.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.175+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.192+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.241+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:09:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.292+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.315+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:00.426 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T13:09:00.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.71', time=2019-11-27T15:08:19.207625+0000, chain.objs.size()=4 2019-11-27T13:09:00.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5__multipart_foo.2~EzuxEigGjzX7LXDN5t_S-PCpqdMFZpM.1 2019-11-27T13:09:00.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5__multipart_foo.2~EzuxEigGjzX7LXDN5t_S-PCpqdMFZpM.2 2019-11-27T13:09:00.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5__multipart_foo.2~EzuxEigGjzX7LXDN5t_S-PCpqdMFZpM.3 2019-11-27T13:09:00.428 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.5__multipart_foo.2~EzuxEigGjzX7LXDN5t_S-PCpqdMFZpM.4 2019-11-27T13:09:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_8mUHklBPnjz_T2Kfghq3HqkwkseVZ5r', time=2019-11-27T15:08:21.128370+0000, chain.objs.size()=2 2019-11-27T13:09:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.PgluU5HfNWmIKnJNBomTS_Gd0kzk3BF_0 2019-11-27T13:09:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.PgluU5HfNWmIKnJNBomTS_Gd0kzk3BF_1 2019-11-27T13:09:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_nW2HrjNZdeSWkuCFLxmFNgq2jdf71ld', time=2019-11-27T15:08:25.672316+0000, chain.objs.size()=2 2019-11-27T13:09:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.ARp2-UZXWcAZU_v3-lRIPtukRWnHaIW_1 2019-11-27T13:09:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.354+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.ARp2-UZXWcAZU_v3-lRIPtukRWnHaIW_2 2019-11-27T13:09:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.613+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.729+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:09:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.788+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.807+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.821+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.822+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.109', time=2019-11-27T15:08:20.899320+0000, chain.objs.size()=2 2019-11-27T13:09:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.822+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.qyFzUUZM3HSk23HrA1V60Rk0j_MZCCx_0 2019-11-27T13:09:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.822+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.qyFzUUZM3HSk23HrA1V60Rk0j_MZCCx_1 2019-11-27T13:09:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:00.877+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.001+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:09:01.127 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.054+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.074+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.105+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.105+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_TEC9ubkjbSuqoHsty00yJTw8ArqUTnk', time=2019-11-27T15:08:23.057130+0000, chain.objs.size()=1 2019-11-27T13:09:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.105+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.nGwpI7tG8zCJqVVU1z-rR3JdVG8qGYv_0 2019-11-27T13:09:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.187+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.347+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:09:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.409+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.428+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.452+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.452+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.242', time=2019-11-27T15:08:26.713992+0000, chain.objs.size()=3 2019-11-27T13:09:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.452+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-STANDARD.2~ZFgM4yGde1R3xCfWUJQEA4plq2o4E6K.1 2019-11-27T13:09:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.452+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-STANDARD.2~ZFgM4yGde1R3xCfWUJQEA4plq2o4E6K.2 2019-11-27T13:09:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.452+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-STANDARD.2~ZFgM4yGde1R3xCfWUJQEA4plq2o4E6K.3 2019-11-27T13:09:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.532+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:01.666 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.593+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:09:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.657+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:01.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.684+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.700+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.748+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:09:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.814+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.839+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:01.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:01.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.203', time=2019-11-27T15:08:28.829089+0000, chain.objs.size()=5 2019-11-27T13:09:01.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-LUKEWARM.2~k5ME8JxiKnKbSg1IJeKLVF69dyhwbMo.1 2019-11-27T13:09:01.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__shadow_foo-LUKEWARM.2~k5ME8JxiKnKbSg1IJeKLVF69dyhwbMo.1_1 2019-11-27T13:09:01.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-LUKEWARM.2~k5ME8JxiKnKbSg1IJeKLVF69dyhwbMo.2 2019-11-27T13:09:01.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__shadow_foo-LUKEWARM.2~k5ME8JxiKnKbSg1IJeKLVF69dyhwbMo.2_1 2019-11-27T13:09:01.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:01.862+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-LUKEWARM.2~k5ME8JxiKnKbSg1IJeKLVF69dyhwbMo.3 2019-11-27T13:09:02.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.032+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.100+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:09:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.146+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.162+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.191+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.191+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.20', time=2019-11-27T15:08:13.688031+0000, chain.objs.size()=4 2019-11-27T13:09:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.191+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2__multipart_foo.2~0EJ5clUV5DyqozOVlKMiq67Wz8Po2LR.1 2019-11-27T13:09:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.191+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2__multipart_foo.2~0EJ5clUV5DyqozOVlKMiq67Wz8Po2LR.2 2019-11-27T13:09:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.191+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2__multipart_foo.2~0EJ5clUV5DyqozOVlKMiq67Wz8Po2LR.3 2019-11-27T13:09:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.191+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.2__multipart_foo.2~0EJ5clUV5DyqozOVlKMiq67Wz8Po2LR.4 2019-11-27T13:09:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.307+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:02.471 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.398+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:09:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.442+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.458+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.474+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.474+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.225', time=2019-11-27T15:08:25.186139+0000, chain.objs.size()=5 2019-11-27T13:09:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.474+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.1 2019-11-27T13:09:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.474+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.1_1 2019-11-27T13:09:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.474+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.2 2019-11-27T13:09:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.474+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.2_1 2019-11-27T13:09:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.475+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.3 2019-11-27T13:09:02.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.522+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.598+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:09:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.657+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:02.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.676+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T13:09:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.40', time=2019-11-27T15:08:15.477092+0000, chain.objs.size()=4 2019-11-27T13:09:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3__multipart_foo.2~daTx9BivVtp8LsCmlevN-amlFvjxWLj.1 2019-11-27T13:09:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3__multipart_foo.2~daTx9BivVtp8LsCmlevN-amlFvjxWLj.2 2019-11-27T13:09:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3__multipart_foo.2~daTx9BivVtp8LsCmlevN-amlFvjxWLj.3 2019-11-27T13:09:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.3__multipart_foo.2~daTx9BivVtp8LsCmlevN-amlFvjxWLj.4 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_XSNad04MQg590_co3r7YWz-fpxm0LsQ', time=2019-11-27T15:08:21.775888+0000, chain.objs.size()=2 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.fjrNq9yefe-_Ig8-yNJVOUAFQhhEAkv_0 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.fjrNq9yefe-_Ig8-yNJVOUAFQhhEAkv_1 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.235', time=2019-11-27T15:08:26.328770+0000, chain.objs.size()=5 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.1 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.1_1 2019-11-27T13:09:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.2 2019-11-27T13:09:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.2_1 2019-11-27T13:09:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.702+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.3 2019-11-27T13:09:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:02.912+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.036+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:09:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.130+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:03.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.157+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.167+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:03.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.220+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:09:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.311+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:03.425 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.353+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.374+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.374+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_zFdKcica9GwoCyodSOR6XYXHjE3f0rr', time=2019-11-27T15:08:21.346397+0000, chain.objs.size()=1 2019-11-27T13:09:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.374+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.9XrLP_yjgUDADIdsLLBv49HV4BoTAyB_1 2019-11-27T13:09:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.420+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:03.582 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.509+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:09:03.629 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.556+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:03.654 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.581+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:03.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.597+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.641+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:09:03.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.700+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.718+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:03.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.747+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:03.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.747+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.84', time=2019-11-27T15:08:30.333445+0000, chain.objs.size()=3 2019-11-27T13:09:03.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.747+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6__shadow_.iXQqAdSLaMH1_R0-dYbYykvEifJejWx_0 2019-11-27T13:09:03.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.747+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6__shadow_.iXQqAdSLaMH1_R0-dYbYykvEifJejWx_1 2019-11-27T13:09:03.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.747+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.6__shadow_.iXQqAdSLaMH1_R0-dYbYykvEifJejWx_2 2019-11-27T13:09:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.825+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:04.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:03.992+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:09:04.108 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.035+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:04.126 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.053+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.233', time=2019-11-27T15:08:25.797492+0000, chain.objs.size()=5 2019-11-27T13:09:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.1 2019-11-27T13:09:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.1_1 2019-11-27T13:09:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.2 2019-11-27T13:09:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.2_1 2019-11-27T13:09:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.065+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-LUKEWARM.2~zwKqjVUg_GTynWF5wjsY3SA5HjnvzFe.3 2019-11-27T13:09:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.171+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.298+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:09:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.386+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.417+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T13:09:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_TGGGEKuXB5dTa43WSmUIEt46nPkzHaO', time=2019-11-27T15:08:22.309301+0000, chain.objs.size()=1 2019-11-27T13:09:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.jGkabqoAVc-xH69Q82jCCTAd3euVtlM_1 2019-11-27T13:09:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.245', time=2019-11-27T15:08:27.344908+0000, chain.objs.size()=3 2019-11-27T13:09:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-STANDARD.2~ZFgM4yGde1R3xCfWUJQEA4plq2o4E6K.1 2019-11-27T13:09:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-STANDARD.2~ZFgM4yGde1R3xCfWUJQEA4plq2o4E6K.2 2019-11-27T13:09:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-STANDARD.2~ZFgM4yGde1R3xCfWUJQEA4plq2o4E6K.3 2019-11-27T13:09:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.196', time=2019-11-27T15:08:28.638435+0000, chain.objs.size()=5 2019-11-27T13:09:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-FROZEN.2~1nyeSDB6HQbS-aJfCK9f4xgQQIFlSsQ.1 2019-11-27T13:09:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__shadow_foo-FROZEN.2~1nyeSDB6HQbS-aJfCK9f4xgQQIFlSsQ.1_1 2019-11-27T13:09:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-FROZEN.2~1nyeSDB6HQbS-aJfCK9f4xgQQIFlSsQ.2 2019-11-27T13:09:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__shadow_foo-FROZEN.2~1nyeSDB6HQbS-aJfCK9f4xgQQIFlSsQ.2_1 2019-11-27T13:09:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.433+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.8__multipart_foo-FROZEN.2~1nyeSDB6HQbS-aJfCK9f4xgQQIFlSsQ.3 2019-11-27T13:09:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.635+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.759+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:09:04.898 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.825+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:04.928 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.855+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.875+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.875+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_5Y6N5QjXqR19gophsIFGHP1OPoWrw-9', time=2019-11-27T15:08:27.032309+0000, chain.objs.size()=1 2019-11-27T13:09:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.875+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.xihQ2zdZCguY6q2QzoHZ9lt7Qp14tfo_0 2019-11-27T13:09:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:04.957+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.087+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:09:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.146+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.172+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.189+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.250+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:09:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.301+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.333+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.348+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.383+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:09:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.443+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.534 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.462+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.472+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.472+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_TnZJymLrwdY7_qU9gYf4qf5w3bOQffC', time=2019-11-27T15:08:26.430402+0000, chain.objs.size()=2 2019-11-27T13:09:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.472+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.gYsu6c2s_PF-2bRR8tVrqTVlcZFoBBR_1 2019-11-27T13:09:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.472+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.gYsu6c2s_PF-2bRR8tVrqTVlcZFoBBR_2 2019-11-27T13:09:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.534+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.610+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:09:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.675+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.704+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.720+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.781+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:09:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.852+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:05.953 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.881+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:09:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.55', time=2019-11-27T15:08:17.684257+0000, chain.objs.size()=4 2019-11-27T13:09:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4__multipart_foo.2~XSz5TOH0Fv7hVzs21bkTLUDcaE5e5GJ.1 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4__multipart_foo.2~XSz5TOH0Fv7hVzs21bkTLUDcaE5e5GJ.2 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4__multipart_foo.2~XSz5TOH0Fv7hVzs21bkTLUDcaE5e5GJ.3 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.4__multipart_foo.2~XSz5TOH0Fv7hVzs21bkTLUDcaE5e5GJ.4 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_j_2LBpdULoXoGEgc5Kcvo6vhg1VBMv1', time=2019-11-27T15:08:26.028889+0000, chain.objs.size()=3 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.JEn2RyHI4MwzW1b4IOlW8JJSxxstD4-_0 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.JEn2RyHI4MwzW1b4IOlW8JJSxxstD4-_1 2019-11-27T13:09:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:05.904+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.JEn2RyHI4MwzW1b4IOlW8JJSxxstD4-_2 2019-11-27T13:09:06.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.080+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.160+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:09:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.209+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:06.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.229+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.239+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.271+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:09:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.335+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:06.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.362+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.394+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:09:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.394+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.108', time=2019-11-27T15:08:20.588511+0000, chain.objs.size()=2 2019-11-27T13:09:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.394+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.qyFzUUZM3HSk23HrA1V60Rk0j_MZCCx_0 2019-11-27T13:09:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.394+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.7__shadow_.qyFzUUZM3HSk23HrA1V60Rk0j_MZCCx_1 2019-11-27T13:09:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.458+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.550+0000 7fe9da759ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:09:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.649+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.670+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:09:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.224', time=2019-11-27T15:08:25.104254+0000, chain.objs.size()=5 2019-11-27T13:09:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.1 2019-11-27T13:09:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.1_1 2019-11-27T13:09:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.2 2019-11-27T13:09:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.2_1 2019-11-27T13:09:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__multipart_foo-FROZEN.2~_SEBezcwS6IbRnwShDvV-BTDiy3UBcG.3 2019-11-27T13:09:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 20 garbage collection: RGWGC::process iterating over entry tag='_6Gw-jNq4o28aDHXsnTxo_bO6u5itpSI', time=2019-11-27T15:08:26.904373+0000, chain.objs.size()=1 2019-11-27T13:09:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.689+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.9__shadow_.gTfOnQhjhwQfPiLDsaNPOchufZ2g0xI_0 2019-11-27T13:09:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.802+0000 7fe9da759ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:09:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.971+0000 7fe9da759ec0 20 remove_watcher() i=0 2019-11-27T13:09:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:06.971+0000 7fe9da759ec0 2 removed watcher, disabling cache 2019-11-27T13:09:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.028+0000 7fe9da759ec0 20 remove_watcher() i=1 2019-11-27T13:09:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.092+0000 7fe9da759ec0 20 remove_watcher() i=2 2019-11-27T13:09:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.157+0000 7fe9da759ec0 20 remove_watcher() i=3 2019-11-27T13:09:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.202+0000 7fe9da759ec0 20 remove_watcher() i=4 2019-11-27T13:09:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.261+0000 7fe9da759ec0 20 remove_watcher() i=5 2019-11-27T13:09:07.362 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.290+0000 7fe9da759ec0 20 remove_watcher() i=6 2019-11-27T13:09:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.321+0000 7fe9da759ec0 20 remove_watcher() i=7 2019-11-27T13:09:07.399 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:09:07.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.430+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.466+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.466+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.476+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.476+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.487+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.487+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.510+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:09:07.797 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.725+0000 7f462fc72ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:09:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.725+0000 7f462fc72ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:09:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.725+0000 7f462fc72ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:09:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.725+0000 7f462fc72ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:09:07.799 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.725+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.741+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:09:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.741+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.755+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:09:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.755+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.774+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:09:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.774+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.864 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.791+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:09:07.864 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.791+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.800+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.800+0000 7f462fc72ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:09:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.800+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.811+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.811+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.830+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:09:07.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.831+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.847+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:09:07.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.847+0000 7f462fc72ec0 20 zonegroup default 2019-11-27T13:09:07.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.847+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.858+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.858+0000 7f462fc72ec0 10 Cannot find current period zone using local zone 2019-11-27T13:09:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.859+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.870+0000 7f462fc72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:09:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.870+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.888+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:09:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.888+0000 7f462fc72ec0 20 rados->read ofs=0 len=0 2019-11-27T13:09:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.904+0000 7f462fc72ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:09:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.904+0000 7f462fc72ec0 20 zone default found 2019-11-27T13:09:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.904+0000 7f462fc72ec0 20 started sync module instance, tier type = 2019-11-27T13:09:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:07.904+0000 7f462fc72ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:09:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=0 2019-11-27T13:09:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=1 2019-11-27T13:09:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=2 2019-11-27T13:09:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=3 2019-11-27T13:09:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=4 2019-11-27T13:09:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=5 2019-11-27T13:09:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.264+0000 7f462fc72ec0 20 add_watcher() i=6 2019-11-27T13:09:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.308+0000 7f462fc72ec0 20 add_watcher() i=7 2019-11-27T13:09:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.308+0000 7f462fc72ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:09:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.308+0000 7f45ecfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:09:08.386 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.314+0000 7f461d6a0700 0 -- 172.21.15.5:0/1116487738 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x559b5bd81480 msgr2=0x559b5bd80810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T13:09:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.526+0000 7f461d6a0700 0 --2- 172.21.15.5:0/1116487738 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x559b5bd81480 0x559b5bd80810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T13:09:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:08.590+0000 7f4617fff700 0 -- 172.21.15.5:0/3049038799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b5bd80830 msgr2=0x559b5bd7cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:09:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:09.955+0000 7f455effd700 20 reqs_thread_entry: start 2019-11-27T13:09:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:09.956+0000 7f455cff9700 20 reqs_thread_entry: start 2019-11-27T13:09:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:09.956+0000 7f462fc72ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:09:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:09.957+0000 7f4552ffd700 20 reqs_thread_entry: start 2019-11-27T13:09:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:09.957+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.021+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.043+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.060+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.105+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:09:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.173+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.208+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.225+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.284+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:09:10.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.356+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.385+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.399+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.452+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:09:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.518+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.543+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.553+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.661 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.589+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:09:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.648+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.671+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.682+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.731+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:09:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.810+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.835+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.848+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.888+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:09:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.941+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.959+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.042 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:10.969+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.009+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:09:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.070+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.110+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.131+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.191+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:09:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.254+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.281+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.295+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.333+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.384+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.403+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.414+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.453+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:09:11.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.498+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.516+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.526+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.562+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.617+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.642+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.658+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.706+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.762+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.791+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.806+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:11.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.860+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:09:12.011 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.937+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.973+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:11.993+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.049+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:09:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.129+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.164+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.179+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.253+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:09:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.336+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.357+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:12.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.370+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.420+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:09:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.511+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.563+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.582+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.621+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:09:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.686+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.705+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.714+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.746+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:09:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.787+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.803+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.812+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.844+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:09:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.897+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.923+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.931+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:12.972+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:09:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.065+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.085+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.096+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.137+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:09:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.191+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.228+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.252+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.303+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:09:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.348+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.374+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.385+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.436+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:09:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.488+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.508+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.519+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.631 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.558+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:09:13.674 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.600+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.690 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.617+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.625+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.652+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:09:13.819 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.745+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.773+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:13.862 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.789+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.843+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:09:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.907+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.933+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.943+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:13.996+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:09:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.058+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.074+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.098+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.137+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:09:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.190+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.209+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.223+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.256+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:09:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.291+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.307+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.315+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.345+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:09:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.384+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.400+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.408+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.450+0000 7f462fc72ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:09:14.597 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.524+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.554+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:09:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.564+0000 7f462fc72ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:09:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.665+0000 7f462fc72ec0 20 remove_watcher() i=0 2019-11-27T13:09:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.665+0000 7f462fc72ec0 2 removed watcher, disabling cache 2019-11-27T13:09:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.701+0000 7f462fc72ec0 20 remove_watcher() i=1 2019-11-27T13:09:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.736+0000 7f462fc72ec0 20 remove_watcher() i=2 2019-11-27T13:09:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.765+0000 7f462fc72ec0 20 remove_watcher() i=3 2019-11-27T13:09:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.796+0000 7f462fc72ec0 20 remove_watcher() i=4 2019-11-27T13:09:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.826+0000 7f462fc72ec0 20 remove_watcher() i=5 2019-11-27T13:09:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.883+0000 7f462fc72ec0 20 remove_watcher() i=6 2019-11-27T13:09:15.006 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:09:14.933+0000 7f462fc72ec0 20 remove_watcher() i=7 2019-11-27T13:09:15.015 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-11-27T13:09:15.633 INFO:teuthology.orchestra.run.smithi005.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-11-27T13:09:18.733 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-11-27T13:09:18.933 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-11-27T13:09:20.034 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :clean UP-TO-DATE 2019-11-27T13:09:20.133 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-11-27T13:09:20.233 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-11-27T13:09:20.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-11-27T13:09:20.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-11-27T13:09:20.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-11-27T13:09:20.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-11-27T13:09:20.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-11-27T13:09:20.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-11-27T13:09:20.733 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-11-27T13:09:20.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-11-27T13:09:20.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-11-27T13:09:20.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-11-27T13:09:20.833 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-11-27T13:09:20.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-11-27T13:09:20.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-11-27T13:09:20.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-11-27T13:09:20.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-11-27T13:09:20.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-11-27T13:09:20.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-11-27T13:09:20.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-11-27T13:09:20.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-11-27T13:09:20.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-11-27T13:09:20.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-11-27T13:09:20.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-11-27T13:09:20.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-11-27T13:09:20.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-11-27T13:09:20.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-11-27T13:09:20.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-11-27T13:09:20.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-11-27T13:09:20.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-11-27T13:09:20.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-11-27T13:09:20.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-11-27T13:09:20.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-11-27T13:09:20.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-11-27T13:09:20.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-11-27T13:09:20.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-11-27T13:09:20.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-11-27T13:09:20.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-11-27T13:09:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-11-27T13:09:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-11-27T13:09:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-11-27T13:09:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-11-27T13:09:20.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-11-27T13:09:20.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-11-27T13:09:20.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-11-27T13:09:20.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-11-27T13:09:20.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-11-27T13:09:20.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-11-27T13:09:20.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-11-27T13:09:20.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-11-27T13:09:20.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-11-27T13:09:20.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-11-27T13:09:20.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-11-27T13:09:20.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-11-27T13:09:20.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-11-27T13:09:20.941 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-11-27T13:09:20.941 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-11-27T13:09:20.941 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-11-27T13:09:20.941 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-11-27T13:09:20.942 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-11-27T13:09:20.942 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-11-27T13:09:20.942 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-11-27T13:09:20.942 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-11-27T13:09:20.943 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-11-27T13:09:20.943 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-11-27T13:09:20.943 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-11-27T13:09:20.943 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-11-27T13:09:21.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-11-27T13:09:21.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-11-27T13:09:21.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-11-27T13:09:21.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-11-27T13:09:21.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-11-27T13:09:21.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-11-27T13:09:21.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-11-27T13:09:21.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-11-27T13:09:21.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-11-27T13:09:21.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-11-27T13:09:21.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-11-27T13:09:21.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-11-27T13:09:21.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-11-27T13:09:21.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-11-27T13:09:21.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-11-27T13:09:21.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-11-27T13:09:21.138 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-11-27T13:09:21.139 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-11-27T13:09:21.139 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-11-27T13:09:21.139 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-11-27T13:09:21.139 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-11-27T13:09:21.139 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-11-27T13:09:21.139 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-11-27T13:09:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-11-27T13:09:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-11-27T13:09:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-11-27T13:09:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-11-27T13:09:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-11-27T13:09:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-11-27T13:09:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-11-27T13:09:21.142 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-11-27T13:09:21.143 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-11-27T13:09:21.143 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-11-27T13:09:21.143 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-11-27T13:09:21.143 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-11-27T13:09:21.143 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-11-27T13:09:21.144 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-11-27T13:09:21.144 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-11-27T13:09:21.239 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-11-27T13:09:21.240 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-11-27T13:09:21.240 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-11-27T13:09:21.240 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-11-27T13:09:21.240 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-11-27T13:09:21.240 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-11-27T13:09:21.240 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-11-27T13:09:21.241 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-11-27T13:09:21.242 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-11-27T13:09:21.242 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-11-27T13:09:21.242 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-11-27T13:09:21.242 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-11-27T13:09:21.242 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-11-27T13:09:21.242 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-11-27T13:09:21.243 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-11-27T13:09:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-11-27T13:09:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-11-27T13:09:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-11-27T13:09:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-11-27T13:09:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-11-27T13:09:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-11-27T13:09:21.334 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-11-27T13:09:21.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-11-27T13:09:21.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-11-27T13:09:21.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-11-27T13:09:21.338 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-11-27T13:09:21.338 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-11-27T13:09:21.338 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-11-27T13:09:21.338 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-11-27T13:09:21.338 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-11-27T13:09:21.433 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-11-27T13:09:21.433 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-11-27T13:09:21.433 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-11-27T13:09:21.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-11-27T13:09:21.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-11-27T13:09:21.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-11-27T13:09:21.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-11-27T13:09:21.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-11-27T13:09:21.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-11-27T13:09:21.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-11-27T13:09:21.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-11-27T13:09:21.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-11-27T13:09:21.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-11-27T13:09:21.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-11-27T13:09:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-11-27T13:09:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-11-27T13:09:21.633 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-11-27T13:09:21.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-11-27T13:09:21.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-11-27T13:09:21.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-11-27T13:09:21.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-11-27T13:09:21.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-11-27T13:09:21.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-11-27T13:09:21.636 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-11-27T13:09:21.636 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-11-27T13:09:21.636 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-11-27T13:09:21.636 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-11-27T13:09:21.636 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-11-27T13:09:21.637 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-11-27T13:09:21.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-11-27T13:09:21.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-11-27T13:09:21.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-11-27T13:09:21.736 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-11-27T13:09:21.736 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-11-27T13:09:21.833 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-11-27T13:09:21.833 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-11-27T13:09:21.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-11-27T13:09:21.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-11-27T13:09:21.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-11-27T13:09:21.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-11-27T13:09:21.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-11-27T13:09:21.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-11-27T13:09:21.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-11-27T13:09:21.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-11-27T13:09:21.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-11-27T13:09:21.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-11-27T13:09:21.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-11-27T13:09:21.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-11-27T13:09:21.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-11-27T13:09:21.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-11-27T13:09:22.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-11-27T13:09:22.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-11-27T13:09:22.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-11-27T13:09:22.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-11-27T13:09:22.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-11-27T13:09:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-11-27T13:09:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-11-27T13:09:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-11-27T13:09:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-11-27T13:09:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-11-27T13:09:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-11-27T13:09:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-11-27T13:09:22.837 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-11-27T13:09:22.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-11-27T13:09:22.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-11-27T13:09:22.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-11-27T13:09:22.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-11-27T13:09:22.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-11-27T13:09:22.937 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-11-27T13:09:22.938 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-11-27T13:09:22.939 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-11-27T13:09:22.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-11-27T13:09:22.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-11-27T13:09:22.940 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-11-27T13:09:23.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-11-27T13:09:23.033 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-11-27T13:09:23.034 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-11-27T13:09:23.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-11-27T13:09:23.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-11-27T13:09:23.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-11-27T13:09:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-11-27T13:09:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-11-27T13:09:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-11-27T13:09:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-11-27T13:09:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-11-27T13:09:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-11-27T13:09:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-11-27T13:09:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-11-27T13:09:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-11-27T13:09:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-11-27T13:09:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-11-27T13:09:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-11-27T13:09:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-11-27T13:09:23.233 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-11-27T13:09:23.233 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-11-27T13:09:23.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-11-27T13:09:23.235 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-11-27T13:09:23.235 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-11-27T13:09:23.235 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-11-27T13:09:23.235 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-11-27T13:09:23.335 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-11-27T13:09:23.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-11-27T13:09:23.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-11-27T13:09:23.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-11-27T13:09:23.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-11-27T13:09:23.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-11-27T13:09:23.336 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-11-27T13:09:23.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-11-27T13:09:23.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-11-27T13:09:23.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-11-27T13:09:23.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-11-27T13:09:23.337 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-11-27T13:09:23.433 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-11-27T13:09:23.433 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-11-27T13:09:23.433 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-11-27T13:09:23.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-11-27T13:09:23.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-11-27T13:09:23.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-11-27T13:09:23.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-11-27T13:09:23.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-11-27T13:09:23.434 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-11-27T13:09:23.533 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-11-27T13:09:23.533 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-11-27T13:09:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-11-27T13:09:23.535 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-11-27T13:09:23.535 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-11-27T13:09:23.633 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-11-27T13:09:23.633 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-11-27T13:09:23.633 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-11-27T13:09:23.634 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-11-27T13:09:23.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-11-27T13:09:23.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-11-27T13:09:23.635 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-11-27T13:09:23.733 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-11-27T13:09:23.733 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-11-27T13:09:23.734 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-11-27T13:09:23.735 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-11-27T13:09:23.833 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-11-27T13:09:23.833 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-11-27T13:09:23.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-11-27T13:09:23.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-11-27T13:09:23.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-11-27T13:09:23.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-11-27T13:09:23.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-11-27T13:09:23.834 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-11-27T13:09:23.835 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-11-27T13:09:23.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-11-27T13:09:23.836 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-11-27T13:09:23.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-11-27T13:09:23.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-11-27T13:09:23.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-11-27T13:09:23.934 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-11-27T13:09:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-11-27T13:09:23.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-11-27T13:09:23.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-11-27T13:09:23.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-11-27T13:09:23.936 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-11-27T13:09:24.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-11-27T13:09:24.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-11-27T13:09:24.035 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-11-27T13:09:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-11-27T13:09:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-11-27T13:09:24.038 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-11-27T13:09:24.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-11-27T13:09:24.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-11-27T13:09:24.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-11-27T13:09:24.039 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-11-27T13:09:24.133 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-11-27T13:09:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-11-27T13:09:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-11-27T13:09:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-11-27T13:09:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-11-27T13:09:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-11-27T13:09:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-11-27T13:09:24.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-11-27T13:09:24.135 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-11-27T13:09:24.233 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-11-27T13:09:24.233 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-11-27T13:09:24.233 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-11-27T13:09:24.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-11-27T13:09:24.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-11-27T13:09:24.234 INFO:teuthology.orchestra.run.smithi005.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-11-27T13:09:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :compileJava 2019-11-27T13:09:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :processResources 2019-11-27T13:09:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :classes 2019-11-27T13:09:34.535 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:09:34.535 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :compileTestJava 2019-11-27T13:09:34.535 INFO:teuthology.orchestra.run.smithi005.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-27T13:09:34.535 INFO:teuthology.orchestra.run.smithi005.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-27T13:09:34.535 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:09:34.536 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :processTestResources NO-SOURCE 2019-11-27T13:09:34.536 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :testClasses 2019-11-27T13:09:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:09:42.335 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :test 2019-11-27T13:09:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:09:42.436 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-11-27T13:10:22.537 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:10:22.537 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-11-27T13:10:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:10:29.638 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-11-27T13:10:33.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:10:33.238 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-11-27T13:10:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:10:40.239 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-11-27T13:10:51.466 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:25.557 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.504 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:25.595 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.518 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:25.609 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.538 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:25.630 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.540 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:16:25.568 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.560 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:16:25.589 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.744 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:16:25.772 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.748 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:25.839 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:10:51.770 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:25.860 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:01.840 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-11-27T13:11:10.741 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:10.741 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-11-27T13:11:11.441 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:11.441 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-11-27T13:11:11.941 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:11.941 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-11-27T13:11:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:16.141 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-11-27T13:11:24.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:24.342 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-11-27T13:11:49.650 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:23.737 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.694 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:23.781 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.700 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:23.786 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.705 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:23.792 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.719 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:17:23.748 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.729 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:17:23.759 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.738 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:23.825 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.747 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:23.833 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:49.781 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:17:23.811 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:11:51.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:11:51.644 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-11-27T13:12:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:12:09.545 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-11-27T13:15:52.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:15:52.352 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-11-27T13:16:03.711 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:37.789 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.713 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:37.792 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.747 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:37.825 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.749 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:37.827 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.792 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:21:37.811 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.797 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:21:37.816 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.886 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:37.964 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.888 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:37.966 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:03.949 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:21:37.967 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:16:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:16:08.352 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-11-27T13:16:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:16:09.953 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-11-27T13:16:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:16:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-11-27T13:16:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:16:20.753 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-11-27T13:16:30.153 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:16:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-11-27T13:16:50.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:16:50.953 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-11-27T13:17:01.753 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:17:01.754 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-11-27T13:17:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:17:01.854 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-11-27T13:17:02.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:17:02.953 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-11-27T13:17:23.423 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T13:17:23.347+0000 41a62700 -1 handle_data failed with exit code -5 2019-11-27T13:17:24.054 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:17:24.054 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-11-27T13:17:32.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:17:32.554 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-11-27T13:17:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:17:56.955 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-11-27T13:18:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:18:10.955 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-11-27T13:18:31.855 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:18:31.855 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-11-27T13:18:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:18:41.556 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-11-27T13:20:11.123 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:45.196 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.145 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:45.218 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.162 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:45.235 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.167 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:45.240 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.200 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:25:45.213 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.204 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:25:45.217 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.316 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:25:45.329 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.334 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:45.407 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:20:11.343 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:45.416 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:26.918 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:00.982 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:26.952 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:32:00.945 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:26.952 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:32:00.955 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:26.952 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:00.990 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:26.952 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:00.999 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:26.953 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:01.004 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:27.172 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:01.236 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:27.183 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:01.248 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:26:27.193 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:32:01.204 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:27:03.666 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:27:03.666 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-11-27T13:27:10.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:27:10.067 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-11-27T13:27:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:27:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-11-27T13:28:05.967 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:28:05.968 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-11-27T13:28:47.468 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:28:47.468 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-11-27T13:28:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:28:55.867 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-11-27T13:29:06.967 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:06.967 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-11-27T13:29:23.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:23.267 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-11-27T13:29:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:24.867 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-11-27T13:29:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:38.733 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-11-27T13:29:38.734 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:38.734 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-11-27T13:29:42.566 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:42.566 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-11-27T13:29:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:45.866 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-11-27T13:29:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:55.966 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-11-27T13:29:59.566 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:29:59.566 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-11-27T13:30:08.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:08.066 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-11-27T13:30:13.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:13.065 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-11-27T13:30:19.265 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:19.265 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-11-27T13:30:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:21.865 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-11-27T13:30:29.965 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:29.965 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-11-27T13:30:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:32.765 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-11-27T13:30:40.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:30:40.665 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-11-27T13:31:13.464 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:31:13.464 INFO:teuthology.orchestra.run.smithi005.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-11-27T13:31:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:31:21.164 INFO:teuthology.orchestra.run.smithi005.stdout:---------------------------------------------------------------------- 2019-11-27T13:31:21.164 INFO:teuthology.orchestra.run.smithi005.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-11-27T13:31:21.164 INFO:teuthology.orchestra.run.smithi005.stdout:---------------------------------------------------------------------- 2019-11-27T13:31:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:31:21.212 INFO:teuthology.orchestra.run.smithi005.stdout:BUILD SUCCESSFUL in 22m 6s 2019-11-27T13:31:21.212 INFO:teuthology.orchestra.run.smithi005.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-11-27T13:31:21.532 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:31:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.703+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.745+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.745+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.753+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.753+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.763+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.763+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:21.787 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.789+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.993+0000 7fa3dc40cec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.993+0000 7fa3dc40cec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.993+0000 7fa3dc40cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.993+0000 7fa3dc40cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:21.993+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.003+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.003+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.015+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.015+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.022+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.022+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.034+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.034+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.040+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.040+0000 7fa3dc40cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:31:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.040+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.045+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.045+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.053+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.053+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.064+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.065+0000 7fa3dc40cec0 20 zonegroup default 2019-11-27T13:31:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.065+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.069+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.069+0000 7fa3dc40cec0 10 Cannot find current period zone using local zone 2019-11-27T13:31:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.069+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.077+0000 7fa3dc40cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.077+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.087+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.087+0000 7fa3dc40cec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.104+0000 7fa3dc40cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.104+0000 7fa3dc40cec0 20 zone default found 2019-11-27T13:31:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.104+0000 7fa3dc40cec0 20 started sync module instance, tier type = 2019-11-27T13:31:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.104+0000 7fa3dc40cec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:31:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=0 2019-11-27T13:31:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=1 2019-11-27T13:31:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=2 2019-11-27T13:31:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=3 2019-11-27T13:31:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=4 2019-11-27T13:31:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=5 2019-11-27T13:31:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.459+0000 7fa3dc40cec0 20 add_watcher() i=6 2019-11-27T13:31:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.488+0000 7fa3dc40cec0 20 add_watcher() i=7 2019-11-27T13:31:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.488+0000 7fa3dc40cec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:31:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.488+0000 7fa399fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:31:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.493+0000 7fa3c9639700 0 -- 172.21.15.5:0/3675182839 >> v2:172.21.15.115:3300/0 conn(0x55bb59ba1570 msgr2=0x55bb59ba1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T13:31:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:22.535+0000 7fa3c9639700 0 -- 172.21.15.5:0/259819897 >> [v2:172.21.15.115:6824/9158,v1:172.21.15.115:6825/9158] conn(0x55bb59bd9b50 msgr2=0x55bb59bdbf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:31:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.343+0000 7fa30bfff700 20 reqs_thread_entry: start 2019-11-27T13:31:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.343+0000 7fa309ffb700 20 reqs_thread_entry: start 2019-11-27T13:31:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.343+0000 7fa3dc40cec0 20 init_complete bucket index max shards: 0 2019-11-27T13:31:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.344+0000 7fa2f7fff700 20 reqs_thread_entry: start 2019-11-27T13:31:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.344+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:31:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.408+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.432+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:31:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.417', time=2019-11-27T15:11:54.360763+0000, chain.objs.size()=9 2019-11-27T13:31:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.1 2019-11-27T13:31:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.1_1 2019-11-27T13:31:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.2 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.2_1 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.3 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.3_1 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.4 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.4_1 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.5 2019-11-27T13:31:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.415', time=2019-11-27T15:12:03.227019+0000, chain.objs.size()=9 2019-11-27T13:31:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.1 2019-11-27T13:31:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.1_1 2019-11-27T13:31:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.453+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.2 2019-11-27T13:31:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.525+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.2_1 2019-11-27T13:31:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.535+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.3 2019-11-27T13:31:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.603+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.3_1 2019-11-27T13:31:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.603+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.4 2019-11-27T13:31:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.603+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__shadow_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.4_1 2019-11-27T13:31:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.639+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.17__multipart_key1.2~8TiuZVs9s0zvifecTjQqDwM3hFDvagr.5 2019-11-27T13:31:24.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.748+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.823+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:31:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.863+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.879+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:24.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.888+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.915+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:31:24.988 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:24.990+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.015+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:25.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.028+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.076+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:31:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.161+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:25.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.183+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:31:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.559', time=2019-11-27T15:18:02.353639+0000, chain.objs.size()=9 2019-11-27T13:31:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.1 2019-11-27T13:31:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.1_1 2019-11-27T13:31:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.2 2019-11-27T13:31:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.2_1 2019-11-27T13:31:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.3 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.3_1 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.4 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.4_1 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file2.mpg.2~FVTWqAGnp-_y6QdAIRVOTY_jMfl8OVc.5 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.608', time=2019-11-27T15:23:34.857807+0000, chain.objs.size()=21 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.1 2019-11-27T13:31:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.1_1 2019-11-27T13:31:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.219+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.2 2019-11-27T13:31:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.379+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.2_1 2019-11-27T13:31:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.3 2019-11-27T13:31:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.3_1 2019-11-27T13:31:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.4 2019-11-27T13:31:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.4_1 2019-11-27T13:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.5 2019-11-27T13:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.5_1 2019-11-27T13:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.6 2019-11-27T13:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.415+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.6_1 2019-11-27T13:31:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.432+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.7 2019-11-27T13:31:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.432+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.7_1 2019-11-27T13:31:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.501+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.8 2019-11-27T13:31:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.501+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.8_1 2019-11-27T13:31:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.619+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.9 2019-11-27T13:31:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.619+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.9_1 2019-11-27T13:31:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.640+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.10 2019-11-27T13:31:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.640+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.10_1 2019-11-27T13:31:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.641+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~X2EWPfqsz2CL3krwLt8KxhT7tf41Luj.11 2019-11-27T13:31:25.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.740+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:25.860 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.862+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:31:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.917+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.940+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:25.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:25.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.460', time=2019-11-27T15:15:10.662423+0000, chain.objs.size()=7 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.1 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.1_1 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.1_2 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.2 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.2_1 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.2_2 2019-11-27T13:31:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:25.952+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~NL9Y2nn8pbrugm25clV1LXGimV-5Jwt.3 2019-11-27T13:31:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.091+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:26.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.207+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:31:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.276+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.292+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:31:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.472', time=2019-11-27T15:15:54.541233+0000, chain.objs.size()=7 2019-11-27T13:31:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.1 2019-11-27T13:31:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.1_1 2019-11-27T13:31:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.1_2 2019-11-27T13:31:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.2 2019-11-27T13:31:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.2_1 2019-11-27T13:31:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.2_2 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~LOIhnmNaHWOJ1BzVplHs5Lrw5X5vC9C.3 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.628', time=2019-11-27T15:25:48.824912+0000, chain.objs.size()=16 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.1 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.1_1 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.1_2 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.2 2019-11-27T13:31:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.310+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.2_1 2019-11-27T13:31:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.504+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.2_2 2019-11-27T13:31:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.504+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.3 2019-11-27T13:31:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.504+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.3_1 2019-11-27T13:31:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.512+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.3_2 2019-11-27T13:31:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.4 2019-11-27T13:31:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.4_1 2019-11-27T13:31:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.4_2 2019-11-27T13:31:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.5 2019-11-27T13:31:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.5_1 2019-11-27T13:31:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.5_2 2019-11-27T13:31:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.542+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~E91-hfiTBWF_AAiCsqkyH1XO4V3ySvM.6 2019-11-27T13:31:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.733+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:26.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.804+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:31:26.843 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.846+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.861+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.869+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.901+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:31:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.954+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:26.971 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.973+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:26.984 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.386', time=2019-11-27T15:11:04.633364+0000, chain.objs.size()=9 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__multipart_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.1 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__shadow_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.1_1 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__multipart_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.2 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__shadow_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.2_1 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__multipart_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.3 2019-11-27T13:31:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__shadow_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.3_1 2019-11-27T13:31:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__multipart_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.4 2019-11-27T13:31:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__shadow_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.4_1 2019-11-27T13:31:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:26.986+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.15__multipart_key1.2~ddqYfoMs67oRU_RCAQRlavdvuQg2o3s.5 2019-11-27T13:31:27.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.196+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.325+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:31:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.388+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.414+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:27.423 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.425+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.464 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.466+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:31:27.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.558+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.586+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.600+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.653+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:31:27.727 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.729+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.768+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.783+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.851+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:31:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.923+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:27.950 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.952+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.977+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:31:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.977+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.528', time=2019-11-27T15:17:27.148241+0000, chain.objs.size()=9 2019-11-27T13:31:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.977+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__multipart_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.1 2019-11-27T13:31:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__shadow_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.1_1 2019-11-27T13:31:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__multipart_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.2 2019-11-27T13:31:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__shadow_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.2_1 2019-11-27T13:31:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__multipart_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.3 2019-11-27T13:31:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__shadow_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.3_1 2019-11-27T13:31:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__multipart_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.4 2019-11-27T13:31:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__shadow_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.4_1 2019-11-27T13:31:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.25__multipart_key1.2~obg1JxOsPxlW-ygdShJbQKkxKWz5uxv.5 2019-11-27T13:31:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.636', time=2019-11-27T15:27:02.536712+0000, chain.objs.size()=16 2019-11-27T13:31:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.1 2019-11-27T13:31:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.1_1 2019-11-27T13:31:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:27.978+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.1_2 2019-11-27T13:31:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.089+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.2 2019-11-27T13:31:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.2_1 2019-11-27T13:31:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.2_2 2019-11-27T13:31:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.3 2019-11-27T13:31:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.3_1 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.3_2 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.4 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.4_1 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.4_2 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.5 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.5_1 2019-11-27T13:31:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.215+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.5_2 2019-11-27T13:31:28.439 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.441+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~lo737IRRDB1kNzCkSFmA-wlNWG53dEb.6 2019-11-27T13:31:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.494+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:28.568 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.571+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:31:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.615+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:28.629 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.632+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:28.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.640+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.680+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:31:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.740+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:28.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.764+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.773+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:28.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.816+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:31:28.889 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.891+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:28.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.921+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:28.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:28.939+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:28.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.000+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:31:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.085+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:29.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.112+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.620', time=2019-11-27T15:24:42.984237+0000, chain.objs.size()=19 2019-11-27T13:31:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.1 2019-11-27T13:31:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.1_1 2019-11-27T13:31:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.2 2019-11-27T13:31:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.2_1 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.3 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.3_1 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.4 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.4_1 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.5 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.5_1 2019-11-27T13:31:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.6 2019-11-27T13:31:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.141+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.6_1 2019-11-27T13:31:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.268+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.7 2019-11-27T13:31:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.282+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.7_1 2019-11-27T13:31:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.291+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.8 2019-11-27T13:31:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.291+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.8_1 2019-11-27T13:31:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.296+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.9 2019-11-27T13:31:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.296+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.9_1 2019-11-27T13:31:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.336+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~NmGhMIPoZaml5OiUBekR0S8psow1lKC.10 2019-11-27T13:31:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.429+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.538+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:31:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.616+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:29.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.643+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.682+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.682+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq', time=2019-11-27T15:29:18.037126+0000, chain.objs.size()=44 2019-11-27T13:31:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.682+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.1 2019-11-27T13:31:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.682+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.2 2019-11-27T13:31:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.682+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.3 2019-11-27T13:31:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.4 2019-11-27T13:31:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.5 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.6 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.7 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.8 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.9 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.10 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.11 2019-11-27T13:31:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.683+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.12 2019-11-27T13:31:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.815+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.13 2019-11-27T13:31:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.815+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.14 2019-11-27T13:31:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.815+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.TOVX51IJwWuf5pcMmW4GHcOn0m5lNmr.15 2019-11-27T13:31:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.815+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.4ux1ESQS5Ff2qDyyLJgj4kxk2W5VCLM.16 2019-11-27T13:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.858+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.hsOFKo1iCbBlxbHgPxOa9w1ttzMz7rh.17 2019-11-27T13:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.858+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.1tm1701OQUeLvDsFi4Y28LtvPEh9XYn.18 2019-11-27T13:31:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.910+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.7PThDoSAtQQbdzjQBD6TC9_LQw6OcDW.19 2019-11-27T13:31:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.910+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.y66H4yvOcMELTo9E3oJU8CkG7g9Wp-5.20 2019-11-27T13:31:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.910+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.21 2019-11-27T13:31:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.910+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.22 2019-11-27T13:31:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.910+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.23 2019-11-27T13:31:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.935+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.24 2019-11-27T13:31:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.974+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.25 2019-11-27T13:31:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.974+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.26 2019-11-27T13:31:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.974+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.27 2019-11-27T13:31:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.974+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.28 2019-11-27T13:31:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:29.974+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.29 2019-11-27T13:31:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.045+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.30 2019-11-27T13:31:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.045+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.31 2019-11-27T13:31:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.045+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.32 2019-11-27T13:31:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.045+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.33 2019-11-27T13:31:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.045+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.34 2019-11-27T13:31:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.045+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.35 2019-11-27T13:31:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.046+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.36 2019-11-27T13:31:30.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.082+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.37 2019-11-27T13:31:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.133+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.38 2019-11-27T13:31:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.133+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.39 2019-11-27T13:31:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.133+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.40 2019-11-27T13:31:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.133+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.41 2019-11-27T13:31:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.142+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.42 2019-11-27T13:31:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.142+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.43 2019-11-27T13:31:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.142+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.31__multipart_key1.2~Og2jdTyAgKHAVYeuAjK7gXk4vcj6CMq.44 2019-11-27T13:31:30.234 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.236+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:30.331 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.333+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:31:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.386+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.424+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:31:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.595', time=2019-11-27T15:22:17.493188+0000, chain.objs.size()=21 2019-11-27T13:31:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.1 2019-11-27T13:31:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.1_1 2019-11-27T13:31:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.2 2019-11-27T13:31:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.2_1 2019-11-27T13:31:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.3 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.3_1 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.4 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.4_1 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.5 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.5_1 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.6 2019-11-27T13:31:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.455+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.6_1 2019-11-27T13:31:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.509+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.7 2019-11-27T13:31:30.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.615+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.7_1 2019-11-27T13:31:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.8 2019-11-27T13:31:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.8_1 2019-11-27T13:31:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.9 2019-11-27T13:31:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.9_1 2019-11-27T13:31:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.10 2019-11-27T13:31:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.10_1 2019-11-27T13:31:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~vfJct9KB4j1pVPIX4HH8UxW7LqmE7Dq.11 2019-11-27T13:31:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.644', time=2019-11-27T15:27:05.793074+0000, chain.objs.size()=16 2019-11-27T13:31:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.1 2019-11-27T13:31:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.660+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.1_1 2019-11-27T13:31:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.664+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.1_2 2019-11-27T13:31:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.823+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.2 2019-11-27T13:31:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.823+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.2_1 2019-11-27T13:31:30.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.2_2 2019-11-27T13:31:30.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.3 2019-11-27T13:31:30.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.3_1 2019-11-27T13:31:30.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.3_2 2019-11-27T13:31:30.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.4 2019-11-27T13:31:30.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.4_1 2019-11-27T13:31:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.4_2 2019-11-27T13:31:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.5 2019-11-27T13:31:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.829+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.5_1 2019-11-27T13:31:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.878+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__shadow_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.5_2 2019-11-27T13:31:30.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:30.911+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.28__multipart_key1.2~yaArNVPINbI9HlSmNTC3y2HLTH7AXkU.6 2019-11-27T13:31:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.224+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.407+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:31:31.482 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.485+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.515+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.438', time=2019-11-27T15:13:35.886783+0000, chain.objs.size()=9 2019-11-27T13:31:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.1 2019-11-27T13:31:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.1_1 2019-11-27T13:31:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.2 2019-11-27T13:31:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.2_1 2019-11-27T13:31:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.3 2019-11-27T13:31:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.3_1 2019-11-27T13:31:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.4 2019-11-27T13:31:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.533+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.4_1 2019-11-27T13:31:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.534+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~XHG2TblTR3bGSB_4p5rPy3T40st14tQ.5 2019-11-27T13:31:31.787 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.789+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.897+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:31:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.947+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:31.966 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.968+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:31.979+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.022+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:31:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.089+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.123+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.509', time=2019-11-27T15:16:53.721601+0000, chain.objs.size()=9 2019-11-27T13:31:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__multipart_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.1 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__shadow_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.1_1 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__multipart_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.2 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__shadow_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.2_1 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__multipart_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.3 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__shadow_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.3_1 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__multipart_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.4 2019-11-27T13:31:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__shadow_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.4_1 2019-11-27T13:31:32.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.151+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.24__multipart_key1.2~j8hRIVI8Cl6jEASFdIGI0cTH7m600FE.5 2019-11-27T13:31:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.314+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.416+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:31:32.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.476+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.500 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.503+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.518+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.555+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:31:32.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.616+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.635 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.638+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:32.646 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.649+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.713+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:31:32.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.778+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.805+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.816+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:32.863 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.866+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:31:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:32.971+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.004+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.446', time=2019-11-27T15:14:05.222298+0000, chain.objs.size()=9 2019-11-27T13:31:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.1 2019-11-27T13:31:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.1_1 2019-11-27T13:31:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.2 2019-11-27T13:31:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.2_1 2019-11-27T13:31:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.3 2019-11-27T13:31:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.3_1 2019-11-27T13:31:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.4 2019-11-27T13:31:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.4_1 2019-11-27T13:31:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.027+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~P9OS7hHkRKoKCrwbhZVtboErTHJmTMN.5 2019-11-27T13:31:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.179+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.264+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:31:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.359+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.385+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T13:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='2~I6HanrUvLLaDodWEmRLrpPpx7T2ZTC3', time=2019-11-27T15:18:35.947398+0000, chain.objs.size()=5 2019-11-27T13:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.27__multipart_key1.2~I6HanrUvLLaDodWEmRLrpPpx7T2ZTC3.7 2019-11-27T13:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.27__shadow_key1.2~I6HanrUvLLaDodWEmRLrpPpx7T2ZTC3.7_1 2019-11-27T13:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.27__multipart_key1.2~I6HanrUvLLaDodWEmRLrpPpx7T2ZTC3.10 2019-11-27T13:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.27__shadow_key1.2~I6HanrUvLLaDodWEmRLrpPpx7T2ZTC3.10_1 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.27__multipart_key1.2~I6HanrUvLLaDodWEmRLrpPpx7T2ZTC3.13 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.674', time=2019-11-27T15:28:50.117714+0000, chain.objs.size()=9 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.409+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__multipart_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.1 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.410+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__shadow_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.1_1 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.410+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__multipart_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.2 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.410+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__shadow_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.2_1 2019-11-27T13:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.410+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__multipart_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.3 2019-11-27T13:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.410+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__shadow_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.3_1 2019-11-27T13:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.410+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__multipart_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.4 2019-11-27T13:31:33.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.576+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__shadow_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.4_1 2019-11-27T13:31:33.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.576+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.30__multipart_key1.2~62xiIvjm_3sGf_zNNcMDUf_DX3mXLLN.5 2019-11-27T13:31:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.641+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.777+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:31:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.820+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.838+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.843', time=2019-11-27T15:31:15.497157+0000, chain.objs.size()=21 2019-11-27T13:31:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.1 2019-11-27T13:31:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.1_1 2019-11-27T13:31:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.2 2019-11-27T13:31:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.2_1 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.3 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.3_1 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.4 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.4_1 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.5 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.5_1 2019-11-27T13:31:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.6 2019-11-27T13:31:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.857+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.6_1 2019-11-27T13:31:33.945 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:33.947+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.7 2019-11-27T13:31:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.009+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.7_1 2019-11-27T13:31:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.009+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.8 2019-11-27T13:31:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.042+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.8_1 2019-11-27T13:31:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.042+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.9 2019-11-27T13:31:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.042+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.9_1 2019-11-27T13:31:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.042+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.10 2019-11-27T13:31:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.042+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__shadow_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.10_1 2019-11-27T13:31:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.042+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.39__multipart_key1.2~hmsNol3MLxOCZR2uHA-Xb5LMwUUcSwg.11 2019-11-27T13:31:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.218+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:34.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.345+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:31:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.411+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.434+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.446+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.481+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:31:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.543+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.563+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:34.577 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.430', time=2019-11-27T15:16:02.397536+0000, chain.objs.size()=5 2019-11-27T13:31:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.19__shadow_.URbae31Ow4bnPKDUvZYvk1eg7VRT7ig_1 2019-11-27T13:31:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.19__shadow_.URbae31Ow4bnPKDUvZYvk1eg7VRT7ig_2 2019-11-27T13:31:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.19__shadow_.URbae31Ow4bnPKDUvZYvk1eg7VRT7ig_3 2019-11-27T13:31:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.19__shadow_.URbae31Ow4bnPKDUvZYvk1eg7VRT7ig_4 2019-11-27T13:31:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.579+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.19__shadow_.URbae31Ow4bnPKDUvZYvk1eg7VRT7ig_5 2019-11-27T13:31:34.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.764+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.871+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.970+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:34.995+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.659', time=2019-11-27T15:27:59.007933+0000, chain.objs.size()=9 2019-11-27T13:31:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__multipart_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.1 2019-11-27T13:31:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__shadow_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.1_1 2019-11-27T13:31:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__multipart_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.2 2019-11-27T13:31:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__shadow_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.2_1 2019-11-27T13:31:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__multipart_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.3 2019-11-27T13:31:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__shadow_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.3_1 2019-11-27T13:31:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__multipart_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.4 2019-11-27T13:31:35.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__shadow_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.4_1 2019-11-27T13:31:35.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.029+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.29__multipart_key1.2~N1tFg4v-duQRgy0TZluGspUojPyTxf8.5 2019-11-27T13:31:35.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.205+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:35.270 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.272+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:31:35.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.312+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:35.326 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.329+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T13:31:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW', time=2019-11-27T15:10:21.725840+0000, chain.objs.size()=9 2019-11-27T13:31:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__multipart_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.1 2019-11-27T13:31:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__shadow_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.1_1 2019-11-27T13:31:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__multipart_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.2 2019-11-27T13:31:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__shadow_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.2_1 2019-11-27T13:31:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__multipart_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.3 2019-11-27T13:31:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__shadow_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.3_1 2019-11-27T13:31:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__multipart_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.4 2019-11-27T13:31:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__shadow_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.4_1 2019-11-27T13:31:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.13__multipart_key1.2~AlNw1fvD5v0_i0ORxTO7Dfxym1FBZhW.5 2019-11-27T13:31:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.454', time=2019-11-27T15:14:30.599069+0000, chain.objs.size()=9 2019-11-27T13:31:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.1 2019-11-27T13:31:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.1_1 2019-11-27T13:31:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.348+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.2 2019-11-27T13:31:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.465+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.2_1 2019-11-27T13:31:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.465+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.3 2019-11-27T13:31:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.475+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.3_1 2019-11-27T13:31:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.475+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.4 2019-11-27T13:31:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.511+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.4_1 2019-11-27T13:31:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.511+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~dz8iYX7MuKMHZP0MH02sSZFYUZ7uhNF.5 2019-11-27T13:31:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.544+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.560', time=2019-11-27T15:17:59.490798+0000, chain.objs.size()=9 2019-11-27T13:31:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.544+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.1 2019-11-27T13:31:35.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.544+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.1_1 2019-11-27T13:31:35.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.544+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.2 2019-11-27T13:31:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.596+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.2_1 2019-11-27T13:31:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.596+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.3 2019-11-27T13:31:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.596+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.3_1 2019-11-27T13:31:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.596+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.4 2019-11-27T13:31:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.596+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__shadow_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.4_1 2019-11-27T13:31:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.596+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.26__multipart_file.mpg.2~jkXEhJwkBxj24x5fB2J4Z6wVD4BJVEf.5 2019-11-27T13:31:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.805+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.900+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:31:35.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.965+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:35.987+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T13:31:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.466', time=2019-11-27T15:15:50.318914+0000, chain.objs.size()=7 2019-11-27T13:31:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.1 2019-11-27T13:31:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.1_1 2019-11-27T13:31:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.1_2 2019-11-27T13:31:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.2 2019-11-27T13:31:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.2_1 2019-11-27T13:31:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__shadow_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.2_2 2019-11-27T13:31:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.005+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.20__multipart_key1.2~vkxIJxmc_EDf-CzpOMyjlV-ef4gfpW1.3 2019-11-27T13:31:36.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.155+0000 7fa3dc40cec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T13:31:36.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.341+0000 7fa3dc40cec0 20 remove_watcher() i=0 2019-11-27T13:31:36.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.341+0000 7fa3dc40cec0 2 removed watcher, disabling cache 2019-11-27T13:31:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.405+0000 7fa3dc40cec0 20 remove_watcher() i=1 2019-11-27T13:31:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.461+0000 7fa3dc40cec0 20 remove_watcher() i=2 2019-11-27T13:31:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.524+0000 7fa3dc40cec0 20 remove_watcher() i=3 2019-11-27T13:31:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.580+0000 7fa3dc40cec0 20 remove_watcher() i=4 2019-11-27T13:31:36.641 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.643+0000 7fa3dc40cec0 20 remove_watcher() i=5 2019-11-27T13:31:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.723+0000 7fa3dc40cec0 20 remove_watcher() i=6 2019-11-27T13:31:36.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.798+0000 7fa3dc40cec0 20 remove_watcher() i=7 2019-11-27T13:31:36.806 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:31:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.921+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.950+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.950+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.957+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.957+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.964+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.964+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:36.982+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:37.024 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:37:11.091 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.028 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:37:11.096 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.041 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:37:11.109 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.047 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:37:11.114 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.048 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:37:11.057 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.058 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:37:11.068 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.144+0000 7ff00b110ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:31:37.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.144+0000 7ff00b110ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:31:37.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.144+0000 7ff00b110ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:31:37.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.144+0000 7ff00b110ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:31:37.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.144+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.155+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.155+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.166+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.167+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.178+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.178+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.191+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.191+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.197+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.198+0000 7ff00b110ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:31:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.198+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.203+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.203+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.213+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.213+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.214 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:37:11.282 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.221 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:37:11.288 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.224+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.224+0000 7ff00b110ec0 20 zonegroup default 2019-11-27T13:31:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.224+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.226 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:37:11.235 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:31:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.230+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.230+0000 7ff00b110ec0 10 Cannot find current period zone using local zone 2019-11-27T13:31:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.230+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.239+0000 7ff00b110ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.239+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.248+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.248+0000 7ff00b110ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.257+0000 7ff00b110ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.257+0000 7ff00b110ec0 20 zone default found 2019-11-27T13:31:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.257+0000 7ff00b110ec0 20 started sync module instance, tier type = 2019-11-27T13:31:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.257+0000 7ff00b110ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:31:37.589 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=0 2019-11-27T13:31:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=1 2019-11-27T13:31:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=2 2019-11-27T13:31:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=3 2019-11-27T13:31:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=4 2019-11-27T13:31:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=5 2019-11-27T13:31:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.592+0000 7ff00b110ec0 20 add_watcher() i=6 2019-11-27T13:31:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.628+0000 7ff00b110ec0 20 add_watcher() i=7 2019-11-27T13:31:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.628+0000 7ff00b110ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:31:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.628+0000 7fefc8fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:31:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.644+0000 7feff833d700 0 -- 172.21.15.5:0/3545966504 >> v2:172.21.15.5:3300/0 conn(0x5582886a2370 msgr2=0x5582886cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T13:31:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:37.878+0000 7feff833d700 0 --2- 172.21.15.5:0/3545966504 >> v2:172.21.15.5:3300/0 conn(0x5582886a2370 0x5582886cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T13:31:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:38.084+0000 7feff8b3e700 0 -- 172.21.15.5:0/888276013 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7fef3c017570 msgr2=0x7fef3c019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T13:31:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.421+0000 7fef3affd700 20 reqs_thread_entry: start 2019-11-27T13:31:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.421+0000 7fef38ff9700 20 reqs_thread_entry: start 2019-11-27T13:31:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.421+0000 7ff00b110ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:31:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.422+0000 7fef2effd700 20 reqs_thread_entry: start 2019-11-27T13:31:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.422+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:31:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.485+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.506+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:39.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.518+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.557+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:31:39.597 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.599+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.618+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.627+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.653+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:31:39.719 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.722+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.764+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.794+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.860+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:31:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.921+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:39.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.944+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:39.958 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:39.960+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.010 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.013+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:31:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.060+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.074 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.076+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.085+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.138+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:31:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.197+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.236+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.253 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.255+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.304 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.307+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:31:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.387+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.408+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.417+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.453+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:31:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.509+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.528 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.531+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.539+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.578+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:31:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.632+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.649+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.658+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.726+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:31:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.798+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.822+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.837+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.875 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.878+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:31:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.949+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.974+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:40.984+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.030+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:31:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.077+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.092 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.095+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.104+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.136+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:31:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.188+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.205+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.215+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.250 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.253+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:31:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.315+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.336+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.352+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.391+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:31:41.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.461+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.490+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.504+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.546+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:31:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.617+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.639+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.652+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.706+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:31:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.788+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.823+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.839+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.891+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:31:41.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.968+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.986+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:41.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:41.996+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.032+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:31:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.076+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.095+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.104 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.107+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.144 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.147+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:31:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.191+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.209+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.218+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.260+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:31:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.349+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.378 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.381+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.394 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.397+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.458+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:31:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.513+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.532+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.542+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.585+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:31:42.655 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.658+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.681+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.693+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.745+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:31:42.817 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.820+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.849+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.865+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.902 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.905+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:31:42.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.964+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:42.984 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.987+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:42.998+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.036+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:31:43.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.094+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.121+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:43.128 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.131+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.166 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.169+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:31:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.231+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.261+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.274+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.328+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:31:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.386+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.411+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:43.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.425+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.462+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:31:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.589+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.611+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.621+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.658+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:31:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.731+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.763+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.778+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.828+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:31:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.892+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.916+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.932+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:43.971+0000 7ff00b110ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:31:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.026+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.048+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.063+0000 7ff00b110ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.161+0000 7ff00b110ec0 20 remove_watcher() i=0 2019-11-27T13:31:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.161+0000 7ff00b110ec0 2 removed watcher, disabling cache 2019-11-27T13:31:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.210+0000 7ff00b110ec0 20 remove_watcher() i=1 2019-11-27T13:31:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.257+0000 7ff00b110ec0 20 remove_watcher() i=2 2019-11-27T13:31:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.297+0000 7ff00b110ec0 20 remove_watcher() i=3 2019-11-27T13:31:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.340+0000 7ff00b110ec0 20 remove_watcher() i=4 2019-11-27T13:31:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.400+0000 7ff00b110ec0 20 remove_watcher() i=5 2019-11-27T13:31:44.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.457+0000 7ff00b110ec0 20 remove_watcher() i=6 2019-11-27T13:31:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.513+0000 7ff00b110ec0 20 remove_watcher() i=7 2019-11-27T13:31:44.518 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:31:44.632 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.634+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.665+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.665+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.674+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.674+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.685+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.685+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.712+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.936+0000 7fde854ceec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:31:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.936+0000 7fde854ceec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:31:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.936+0000 7fde854ceec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:31:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.936+0000 7fde854ceec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:31:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.936+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.955+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.955+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.969+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.969+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.983+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.983+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:44.999+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.000+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.011+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.011+0000 7fde854ceec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:31:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.011+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.023+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.023+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.049+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.049+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.062+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.062+0000 7fde854ceec0 20 zonegroup default 2019-11-27T13:31:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.062+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.071+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.071+0000 7fde854ceec0 10 Cannot find current period zone using local zone 2019-11-27T13:31:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.071+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.080+0000 7fde854ceec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.080+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.093+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.093+0000 7fde854ceec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.105+0000 7fde854ceec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.105+0000 7fde854ceec0 20 zone default found 2019-11-27T13:31:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.105+0000 7fde854ceec0 20 started sync module instance, tier type = 2019-11-27T13:31:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.105+0000 7fde854ceec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:31:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=0 2019-11-27T13:31:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=1 2019-11-27T13:31:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=2 2019-11-27T13:31:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=3 2019-11-27T13:31:45.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=4 2019-11-27T13:31:45.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=5 2019-11-27T13:31:45.509 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.511+0000 7fde854ceec0 20 add_watcher() i=6 2019-11-27T13:31:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.543+0000 7fde854ceec0 20 add_watcher() i=7 2019-11-27T13:31:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.543+0000 7fde854ceec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:31:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.543+0000 7fde42fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:31:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.555+0000 7fde72efc700 0 -- 172.21.15.5:0/3264108370 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dce5110340 msgr2=0x55dce5124690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:31:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:45.575+0000 7fde726fb700 0 -- 172.21.15.5:0/2752421612 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dce511a4e0 msgr2=0x55dce514f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:31:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.107+0000 7fddb17fa700 20 reqs_thread_entry: start 2019-11-27T13:31:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.108+0000 7fddaaffd700 20 reqs_thread_entry: start 2019-11-27T13:31:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.108+0000 7fde854ceec0 20 init_complete bucket index max shards: 0 2019-11-27T13:31:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.108+0000 7fdda97fa700 20 reqs_thread_entry: start 2019-11-27T13:31:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.108+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:31:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.148+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.162 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.165+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.173+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.209+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:31:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.262+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.284+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:47.288 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.291+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.333 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.335+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:31:47.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.405+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.430+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.439+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.493 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.496+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:31:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.569+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.591+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.602+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.653+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:31:47.709 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.711+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.736+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.749+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.787+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:31:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.864+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.888+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.900+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:47.951+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:31:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.023+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.058+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:48.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.076+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.132+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:31:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.316+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.370+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.385+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.442+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:31:48.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.505+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.525+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.534+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.576+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:31:48.696 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.699+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.734+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:48.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.749+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.806+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:31:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.881+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.911+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.923+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:48.977+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:31:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.049+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.063 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.066+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.080+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.126+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:31:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.186+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.210+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.223+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.265 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.268+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:31:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.325+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.346+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.361+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.404+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:31:49.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.476+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.501 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.504+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.519+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.575+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:31:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.624+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.641+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.672+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.718+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:31:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.776+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.794+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.810+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.852+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:31:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.893+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.909+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.918+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:49.943 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:49.945+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:31:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.004+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.025+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.038+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.092+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:31:50.148 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.151+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.181+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.199+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.252 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.255+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:31:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.316+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.339+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.354+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.411+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:31:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.462+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.482+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.493+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.527+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:31:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.575+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.588 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.591+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.599+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.638+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:31:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.682+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.704+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.718+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.776+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:31:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.875+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.904+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.920+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:50.975 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:50.978+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:31:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.051+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.075+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.091+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.156+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:31:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.206+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.228+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.243+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.284+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:31:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.338+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.365+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.376+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.434+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:31:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.484+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.506+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.518+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.562 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.564+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:31:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.619+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.640+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.649+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.684+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:31:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.733+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.767+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.775+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.817+0000 7fde854ceec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:31:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.868+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.886+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.895+0000 7fde854ceec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:51.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.984+0000 7fde854ceec0 20 remove_watcher() i=0 2019-11-27T13:31:51.982 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:51.984+0000 7fde854ceec0 2 removed watcher, disabling cache 2019-11-27T13:31:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.015+0000 7fde854ceec0 20 remove_watcher() i=1 2019-11-27T13:31:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.044+0000 7fde854ceec0 20 remove_watcher() i=2 2019-11-27T13:31:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.096+0000 7fde854ceec0 20 remove_watcher() i=3 2019-11-27T13:31:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.132+0000 7fde854ceec0 20 remove_watcher() i=4 2019-11-27T13:31:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.176+0000 7fde854ceec0 20 remove_watcher() i=5 2019-11-27T13:31:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.226+0000 7fde854ceec0 20 remove_watcher() i=6 2019-11-27T13:31:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.278+0000 7fde854ceec0 20 remove_watcher() i=7 2019-11-27T13:31:52.285 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:31:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.421+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.450+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.450+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.457+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.457+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.467+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.467+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.484+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.691+0000 7f18bf305ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:31:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.691+0000 7f18bf305ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:31:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.691+0000 7f18bf305ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:31:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.691+0000 7f18bf305ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:31:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.691+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.709+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.709+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.726+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.726+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.740+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.740+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.750+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.750+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.760+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.760+0000 7f18bf305ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:31:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.760+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.776+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.776+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.794+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.794+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.804+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:31:52.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.804+0000 7f18bf305ec0 20 zonegroup default 2019-11-27T13:31:52.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.804+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.812+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.812+0000 7f18bf305ec0 10 Cannot find current period zone using local zone 2019-11-27T13:31:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.812+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.820+0000 7f18bf305ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:31:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.820+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.831+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:31:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.831+0000 7f18bf305ec0 20 rados->read ofs=0 len=0 2019-11-27T13:31:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.841+0000 7f18bf305ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:31:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.841+0000 7f18bf305ec0 20 zone default found 2019-11-27T13:31:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.841+0000 7f18bf305ec0 20 started sync module instance, tier type = 2019-11-27T13:31:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:52.841+0000 7f18bf305ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:31:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.172+0000 7f18bf305ec0 20 add_watcher() i=0 2019-11-27T13:31:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.172+0000 7f18bf305ec0 20 add_watcher() i=1 2019-11-27T13:31:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.172+0000 7f18bf305ec0 20 add_watcher() i=2 2019-11-27T13:31:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.172+0000 7f18bf305ec0 20 add_watcher() i=3 2019-11-27T13:31:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.172+0000 7f18bf305ec0 20 add_watcher() i=4 2019-11-27T13:31:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.172+0000 7f18bf305ec0 20 add_watcher() i=5 2019-11-27T13:31:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.187+0000 7f18bf305ec0 20 add_watcher() i=6 2019-11-27T13:31:53.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.210+0000 7f18bf305ec0 20 add_watcher() i=7 2019-11-27T13:31:53.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.210+0000 7f18bf305ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:31:53.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.210+0000 7f187cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:31:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.214+0000 7f18ac532700 0 -- 172.21.15.5:0/2693645971 >> v1:172.21.15.5:6789/0 conn(0x56039499f490 legacy=0x56039499b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:31:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:53.256+0000 7f18acd33700 0 -- 172.21.15.5:0/2760799586 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f17f00036d0 msgr2=0x7f17f0003ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:31:54.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.770+0000 7f17eeffd700 20 reqs_thread_entry: start 2019-11-27T13:31:54.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.771+0000 7f17ecff9700 20 reqs_thread_entry: start 2019-11-27T13:31:54.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.771+0000 7f18bf305ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:31:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.772+0000 7f17e2ffd700 20 reqs_thread_entry: start 2019-11-27T13:31:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.772+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:31:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.843+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.869+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.881+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.928+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:31:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:54.997+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.021+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:55.030 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.033+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.082+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:31:55.167 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.170+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:55.204 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.206+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.220+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:55.280 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.283+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:31:55.359 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.362+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.388+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.406+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.453+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:31:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.524+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.546+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.555+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.605+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:31:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.678+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.701+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.713+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.757+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:31:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.847+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.867+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.880+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.923+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:31:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:55.981+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.015+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.025+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.063+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:31:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.101+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.117+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.125+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.156+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:31:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.201+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.218+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.227+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.276+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:31:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.379+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.407+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.421+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.458+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:31:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.523+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.550+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.561+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.599+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:31:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.677+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.704+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.719+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.766+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:31:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.834+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.855+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.867+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.907+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.957+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.981+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:56.990+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.025+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.068+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.084+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.093+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.124+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:31:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.182+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.205+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.214+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.252+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:31:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.308+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.330+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.337 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.340+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.387+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:31:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.459+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.489 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.492+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.497 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.501+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.537 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.540+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:31:57.624 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.627+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.649+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.660+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.702+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:31:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.747+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.764+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.773+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.810+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:31:57.858 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.861+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.880+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:57.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.889+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.925+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:31:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:57.981+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.008+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.020+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.064+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:31:58.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.113+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.132+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.144+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.181+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:31:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.227+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.245+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.254+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.286+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:31:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.329+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.345+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.355+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.385+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:31:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.431+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.449+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.458+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.494 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.497+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:31:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.552+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.577+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.590+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.728+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:31:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.819+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.851+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.865+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.930+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:31:58.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:58.998+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.026+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:59.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.039+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:59.081 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.084+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:31:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.148+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.174+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:59.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.189+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.227+0000 7f18bf305ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:31:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.286+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.307+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:31:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.317+0000 7f18bf305ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:31:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.395+0000 7f18bf305ec0 20 remove_watcher() i=0 2019-11-27T13:31:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.395+0000 7f18bf305ec0 2 removed watcher, disabling cache 2019-11-27T13:31:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.483+0000 7f18bf305ec0 20 remove_watcher() i=1 2019-11-27T13:31:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.532+0000 7f18bf305ec0 20 remove_watcher() i=2 2019-11-27T13:31:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.607+0000 7f18bf305ec0 20 remove_watcher() i=3 2019-11-27T13:31:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.675+0000 7f18bf305ec0 20 remove_watcher() i=4 2019-11-27T13:31:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.717+0000 7f18bf305ec0 20 remove_watcher() i=5 2019-11-27T13:31:59.769 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.772+0000 7f18bf305ec0 20 remove_watcher() i=6 2019-11-27T13:31:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:31:59.837+0000 7f18bf305ec0 20 remove_watcher() i=7 2019-11-27T13:31:59.843 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-11-27T13:32:00.580 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :clean 2019-11-27T13:32:01.277 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :compileJava 2019-11-27T13:32:01.277 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :processResources 2019-11-27T13:32:01.277 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :classes 2019-11-27T13:32:01.578 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:01.578 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :compileTestJava 2019-11-27T13:32:01.578 INFO:teuthology.orchestra.run.smithi005.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-27T13:32:01.578 INFO:teuthology.orchestra.run.smithi005.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-27T13:32:01.579 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:01.579 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :processTestResources NO-SOURCE 2019-11-27T13:32:01.579 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :testClasses 2019-11-27T13:32:03.777 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:03.777 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :test 2019-11-27T13:32:03.777 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:03.777 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-11-27T13:32:05.977 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:05.977 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-11-27T13:32:12.177 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:12.177 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-11-27T13:32:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-11-27T13:32:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:21.677 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-11-27T13:32:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:23.977 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-11-27T13:32:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:29.877 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-11-27T13:32:36.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:36.577 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-11-27T13:32:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:37.677 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-11-27T13:32:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:42.676 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-11-27T13:32:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:50.177 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-11-27T13:32:50.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:50.876 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-11-27T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:32:53.277 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-11-27T13:33:01.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:01.576 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-11-27T13:33:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:15.976 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-11-27T13:33:18.976 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:18.976 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-11-27T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:32.741 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-11-27T13:33:32.743 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:32.743 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-11-27T13:33:32.743 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:32.744 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------- 2019-11-27T13:33:32.744 INFO:teuthology.orchestra.run.smithi005.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-11-27T13:33:32.744 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------- 2019-11-27T13:33:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:33:32.744 INFO:teuthology.orchestra.run.smithi005.stdout:BUILD SUCCESSFUL in 1m 29s 2019-11-27T13:33:32.744 INFO:teuthology.orchestra.run.smithi005.stdout:5 actionable tasks: 5 executed 2019-11-27T13:33:32.745 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:33:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.916+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:32.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.944+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:32.941 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.945+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:32.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.952+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:32.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.952+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:32.956 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.960+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:32.956 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.960+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:32.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:32.977+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:33.163 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.167+0000 7fb6c021bec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:33:33.163 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.167+0000 7fb6c021bec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:33:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.167+0000 7fb6c021bec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:33:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.167+0000 7fb6c021bec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:33:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.167+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.180+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.180+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.197+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:33.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.197+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.211+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.211+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.230+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.230+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.238+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.238+0000 7fb6c021bec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.238+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.244+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.245+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.256+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.256+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.272+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.272+0000 7fb6c021bec0 20 zonegroup default 2019-11-27T13:33:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.272+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.280+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.280+0000 7fb6c021bec0 10 Cannot find current period zone using local zone 2019-11-27T13:33:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.280+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.290+0000 7fb6c021bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.290+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.301+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:33.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.301+0000 7fb6c021bec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.313+0000 7fb6c021bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.313+0000 7fb6c021bec0 20 zone default found 2019-11-27T13:33:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.313+0000 7fb6c021bec0 20 started sync module instance, tier type = 2019-11-27T13:33:33.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.313+0000 7fb6c021bec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:33:33.648 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=0 2019-11-27T13:33:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=1 2019-11-27T13:33:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=2 2019-11-27T13:33:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=3 2019-11-27T13:33:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=4 2019-11-27T13:33:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=5 2019-11-27T13:33:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.652+0000 7fb6c021bec0 20 add_watcher() i=6 2019-11-27T13:33:33.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.684+0000 7fb6c021bec0 20 add_watcher() i=7 2019-11-27T13:33:33.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.684+0000 7fb6c021bec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:33:33.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.684+0000 7fb67dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.706+0000 7fb6a4c47700 0 -- 172.21.15.5:0/3361411652 >> v2:172.21.15.5:3300/0 conn(0x55c190dc5080 msgr2=0x55c190dc74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T13:33:33.933 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.937+0000 7fb6a4c47700 0 --2- 172.21.15.5:0/3361411652 >> v2:172.21.15.5:3300/0 conn(0x55c190dc5080 0x55c190dc74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T13:33:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:33.990+0000 7fb6a4c47700 0 -- 172.21.15.5:0/536685707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c190dcc240 msgr2=0x55c190dce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:33:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.608+0000 7fb5effff700 20 reqs_thread_entry: start 2019-11-27T13:33:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.608+0000 7fb5edffb700 20 reqs_thread_entry: start 2019-11-27T13:33:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.609+0000 7fb6c021bec0 20 init_complete bucket index max shards: 0 2019-11-27T13:33:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.609+0000 7fb5dbfff700 20 reqs_thread_entry: start 2019-11-27T13:33:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.609+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:33:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.666+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.688+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:35.698 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.702+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.753+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:33:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.807+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.827+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:35.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.836+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.868+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:33:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.953+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.985+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:35.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:35.996+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.042+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:33:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.087+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.102+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.111+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.160+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:33:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.220+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.241+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.250+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.288+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:33:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.362+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.392+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.403+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.451+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:33:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.522+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.548+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.559+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.585+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:33:36.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.644+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.661+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.670+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.711+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:33:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.780+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.800 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.803+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.816+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.859+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:33:36.917 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.921+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:36.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.952+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:36.969+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.017+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:33:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.073+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.100 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.104+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.116+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.151+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:33:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.195+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.212+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.222+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.260+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:33:37.322 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.325+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.350+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.360+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.398 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.402+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:33:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.476+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.502+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.516+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.562+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:33:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.635+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.657+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.668+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.700 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.703+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:33:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.800+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.834+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.852+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.912+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:33:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:37.981+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.006+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.020+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.085+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:33:38.128 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.132+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.149+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.158+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.198+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:33:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.368+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.389 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.392+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.406+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.459+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:33:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.529+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.558+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.568+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.630+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:33:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.709+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.750+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.766+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.804 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.808+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:33:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.868+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.894+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.908+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:38.954+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:33:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.020+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.044+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.059+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.107+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:33:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.168+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.189+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.198+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.233+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:33:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.286+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.301+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.311+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.347 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.351+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:33:39.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.400+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.416 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.420+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.430+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.471+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:33:39.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.539+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.563+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.576 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.579+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.638+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:33:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.711+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.746+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.758 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.762+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.812+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:33:39.869 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.873+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.896+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.910+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:39.952+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:33:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.132+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:40.163 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.166+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:40.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.182+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.236+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:33:40.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.313+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:40.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.348+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.362+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.454+0000 7fb6c021bec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:33:40.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.540+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.570+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.583+0000 7fb6c021bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.697+0000 7fb6c021bec0 20 remove_watcher() i=0 2019-11-27T13:33:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.697+0000 7fb6c021bec0 2 removed watcher, disabling cache 2019-11-27T13:33:40.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.746+0000 7fb6c021bec0 20 remove_watcher() i=1 2019-11-27T13:33:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.799+0000 7fb6c021bec0 20 remove_watcher() i=2 2019-11-27T13:33:40.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.861+0000 7fb6c021bec0 20 remove_watcher() i=3 2019-11-27T13:33:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.908+0000 7fb6c021bec0 20 remove_watcher() i=4 2019-11-27T13:33:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:40.960+0000 7fb6c021bec0 20 remove_watcher() i=5 2019-11-27T13:33:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.010+0000 7fb6c021bec0 20 remove_watcher() i=6 2019-11-27T13:33:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.054+0000 7fb6c021bec0 20 remove_watcher() i=7 2019-11-27T13:33:41.059 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:33:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.195+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.228+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.228+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.233+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.233+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.241+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.241+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.258+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.465+0000 7f31146d3ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:33:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.465+0000 7f31146d3ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:33:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.465+0000 7f31146d3ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:33:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.465+0000 7f31146d3ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:33:41.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.465+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.479+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:41.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.479+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.498+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.498+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.516+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.516+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.536+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.536+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.547+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.547+0000 7f31146d3ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:33:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.547+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.557+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.557+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.578+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.578+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.598+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.598+0000 7f31146d3ec0 20 zonegroup default 2019-11-27T13:33:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.598+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.613+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.613+0000 7f31146d3ec0 10 Cannot find current period zone using local zone 2019-11-27T13:33:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.613+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.623+0000 7f31146d3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.623+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.636+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.636+0000 7f31146d3ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.648+0000 7f31146d3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.648+0000 7f31146d3ec0 20 zone default found 2019-11-27T13:33:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.648+0000 7f31146d3ec0 20 started sync module instance, tier type = 2019-11-27T13:33:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:41.648+0000 7f31146d3ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=0 2019-11-27T13:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=1 2019-11-27T13:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=2 2019-11-27T13:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=3 2019-11-27T13:33:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=4 2019-11-27T13:33:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=5 2019-11-27T13:33:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.015+0000 7f31146d3ec0 20 add_watcher() i=6 2019-11-27T13:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.052+0000 7f31146d3ec0 20 add_watcher() i=7 2019-11-27T13:33:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.052+0000 7f31146d3ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:33:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.052+0000 7f30d27dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:33:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.055+0000 7f31010ff700 0 -- 172.21.15.5:0/752646846 >> v2:172.21.15.5:3300/0 conn(0x56228ba97070 msgr2=0x56228ba99490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T13:33:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:42.079+0000 7f31010ff700 0 -- 172.21.15.5:0/31895153 >> v2:172.21.15.115:3300/0 conn(0x56228ba98100 msgr2=0x56228ba848d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T13:33:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.611+0000 7f3048ff9700 20 reqs_thread_entry: start 2019-11-27T13:33:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.611+0000 7f30427fc700 20 reqs_thread_entry: start 2019-11-27T13:33:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.611+0000 7f31146d3ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:33:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.612+0000 7f3040ff9700 20 reqs_thread_entry: start 2019-11-27T13:33:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.612+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:33:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.658+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.677+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.686+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.724+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:33:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.775+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.794+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.804+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.863+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:33:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.920+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.941+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.952+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:43.990+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:33:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.053+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.075+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.088+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.124+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:33:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.180+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.197 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.201+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.211+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.257+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:33:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.331+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.357+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.370+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.417+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:33:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.500+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.531+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.548+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.611+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:33:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.697+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.727+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.746+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.783 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.787+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:33:44.855 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.858+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.877 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.881+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.895+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:44.937+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:33:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.016+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.048+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.059+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.123+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:33:45.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.162+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.177+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.182 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.185+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.217+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:33:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.262+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.279+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.288+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.322+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:33:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.373+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.399+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.409+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.445+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:33:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.506+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.526+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.535+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.578+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:33:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.616+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.632+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.643+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.674 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.678+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:33:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.721+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.746+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.758+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.786 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.790+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:33:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.842+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.858 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.862+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.871+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.910+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:33:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.962+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:45.989+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.025 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.006+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.042+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:33:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.113+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.142+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.151+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.191+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.240+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.258+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.267+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.310+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.376+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.408+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.427+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.487+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:33:46.546 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.549+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.577+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.584 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.588+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.635 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.639+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:33:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.696+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.714+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.720 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.723+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.775+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:33:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.842+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.865+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:46.876 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.880+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:46.929 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.933+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:33:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:46.981+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.005+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.017+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.066+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:33:47.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.157+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.181+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.189 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.192+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.249+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:33:47.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.294+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.311+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.315 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.319+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.357 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.361+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:33:47.406 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.410+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.436+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.447+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.494 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.497+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:33:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.548+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.565+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.582+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.632+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:33:47.701 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.705+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.735+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.750+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.802+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:33:47.870 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.874+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.900+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.915+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:47.958 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:47.962+0000 7f31146d3ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:33:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.025+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.055+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.068+0000 7f31146d3ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.164+0000 7f31146d3ec0 20 remove_watcher() i=0 2019-11-27T13:33:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.164+0000 7f31146d3ec0 2 removed watcher, disabling cache 2019-11-27T13:33:48.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.213+0000 7f31146d3ec0 20 remove_watcher() i=1 2019-11-27T13:33:48.242 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.246+0000 7f31146d3ec0 20 remove_watcher() i=2 2019-11-27T13:33:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.294+0000 7f31146d3ec0 20 remove_watcher() i=3 2019-11-27T13:33:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.335+0000 7f31146d3ec0 20 remove_watcher() i=4 2019-11-27T13:33:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.379+0000 7f31146d3ec0 20 remove_watcher() i=5 2019-11-27T13:33:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.429+0000 7f31146d3ec0 20 remove_watcher() i=6 2019-11-27T13:33:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.470+0000 7f31146d3ec0 20 remove_watcher() i=7 2019-11-27T13:33:48.473 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:33:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.609+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.634 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.638+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:48.634 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.638+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.660+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.660+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.671+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.671+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.694 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.698+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.908+0000 7fbc92aa5ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:33:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.908+0000 7fbc92aa5ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:33:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.908+0000 7fbc92aa5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:33:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.908+0000 7fbc92aa5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:33:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.908+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.926+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.926+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.944+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.944+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.958+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.958+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.976+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.976+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.986+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.986+0000 7fbc92aa5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:33:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.986+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.996+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:48.996+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.009+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.010+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.021+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.021+0000 7fbc92aa5ec0 20 zonegroup default 2019-11-27T13:33:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.021+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.032+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.032+0000 7fbc92aa5ec0 10 Cannot find current period zone using local zone 2019-11-27T13:33:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.032+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.038+0000 7fbc92aa5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.038+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.050+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.050+0000 7fbc92aa5ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.059+0000 7fbc92aa5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.059+0000 7fbc92aa5ec0 20 zone default found 2019-11-27T13:33:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.059+0000 7fbc92aa5ec0 20 started sync module instance, tier type = 2019-11-27T13:33:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.059+0000 7fbc92aa5ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:33:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.446+0000 7fbc92aa5ec0 20 add_watcher() i=0 2019-11-27T13:33:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.446+0000 7fbc92aa5ec0 20 add_watcher() i=1 2019-11-27T13:33:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.446+0000 7fbc92aa5ec0 20 add_watcher() i=2 2019-11-27T13:33:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.446+0000 7fbc92aa5ec0 20 add_watcher() i=3 2019-11-27T13:33:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.446+0000 7fbc92aa5ec0 20 add_watcher() i=4 2019-11-27T13:33:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.446+0000 7fbc92aa5ec0 20 add_watcher() i=5 2019-11-27T13:33:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.447+0000 7fbc92aa5ec0 20 add_watcher() i=6 2019-11-27T13:33:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.486+0000 7fbc92aa5ec0 20 add_watcher() i=7 2019-11-27T13:33:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.486+0000 7fbc92aa5ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:33:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.486+0000 7fbc4f7ee700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:33:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.489+0000 7fbc7f4d1700 0 -- 172.21.15.5:0/100847242 >> v2:172.21.15.5:3300/0 conn(0x559c25dabe50 msgr2=0x559c25dac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T13:33:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:49.524+0000 7fbc7fcd2700 0 -- 172.21.15.5:0/12592592 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7fbbc0017580 msgr2=0x7fbbc0019a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T13:33:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.194+0000 7fbbbdffb700 20 reqs_thread_entry: start 2019-11-27T13:33:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.194+0000 7fbbb77fe700 20 reqs_thread_entry: start 2019-11-27T13:33:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.195+0000 7fbc92aa5ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:33:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.195+0000 7fbbb5ffb700 20 reqs_thread_entry: start 2019-11-27T13:33:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.195+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:33:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.235+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.250 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.254+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.264+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.301+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:33:51.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.346+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.367+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:51.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.377+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.407+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:33:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.462+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.482+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.491+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.533+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:33:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.611+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.640+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.656+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.711+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:33:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.791+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.816 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.820+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.840+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.890+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:33:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.948+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.974+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:51.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:51.985+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.019+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:33:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.057+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.072+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.082+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.123+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:33:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.184+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.206+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:52.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.215+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.263+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:33:52.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.352+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.391+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:52.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.413+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.469+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:33:52.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.535+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.553+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.564+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.715+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:33:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.797+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.827+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.844+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.919+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:33:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:52.997+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.028+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.041+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.080+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:33:53.134 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.138+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.157+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.166+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.212+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:33:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.296+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.329+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.364+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.399+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:33:53.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.450+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.492 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.495+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.500 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.504+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.549+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:33:53.604 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.608+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.655+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.663+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.712+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:33:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.760+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.789+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.803+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.836+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:33:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.907+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.930 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.934+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.948+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:53.999+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.057+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.070 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.074+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.079 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.083+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.119+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:33:54.152 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.155+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.171+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.180+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.208 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.212+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:33:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.251+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.266+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.271 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.275+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.304+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:33:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.344+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.362+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.371+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.399 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.403+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:33:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.474+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.500+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.509+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.561+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:33:54.622 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.626+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.648+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.659+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.696+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:33:54.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.754+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.767 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.771+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.780+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.830+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:33:54.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.895+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.918+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.929+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:54.965 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:54.969+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:33:55.006 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.010+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.027+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:55.033 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.037+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.070+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:33:55.116 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.120+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.143+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:55.154 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.158+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.215+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:33:55.284 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.288+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.319+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:55.330 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.334+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.374+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:33:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.426+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.444+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.453+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.491 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.495+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:33:55.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.558+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.576 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.580+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:55.586 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.590+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.621+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:33:55.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.659+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.679+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.688+0000 7fbc92aa5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:55.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.778+0000 7fbc92aa5ec0 20 remove_watcher() i=0 2019-11-27T13:33:55.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.778+0000 7fbc92aa5ec0 2 removed watcher, disabling cache 2019-11-27T13:33:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.824+0000 7fbc92aa5ec0 20 remove_watcher() i=1 2019-11-27T13:33:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.866+0000 7fbc92aa5ec0 20 remove_watcher() i=2 2019-11-27T13:33:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.900+0000 7fbc92aa5ec0 20 remove_watcher() i=3 2019-11-27T13:33:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.934+0000 7fbc92aa5ec0 20 remove_watcher() i=4 2019-11-27T13:33:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:55.966+0000 7fbc92aa5ec0 20 remove_watcher() i=5 2019-11-27T13:33:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.001+0000 7fbc92aa5ec0 20 remove_watcher() i=6 2019-11-27T13:33:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.035+0000 7fbc92aa5ec0 20 remove_watcher() i=7 2019-11-27T13:33:56.039 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T13:33:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.148+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.179+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.179+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.190+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.190+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.195 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.199+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.196 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.199+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.220+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:56.426 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.430+0000 7f34c8fe8ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T13:33:56.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.430+0000 7f34c8fe8ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T13:33:56.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.430+0000 7f34c8fe8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T13:33:56.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.430+0000 7f34c8fe8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T13:33:56.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.430+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.447+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:56.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.447+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.462+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.462+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.473 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.477+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.477+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.491 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.495+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.495+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.506+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.506+0000 7f34c8fe8ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T13:33:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.506+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.512 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.516+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.516+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.526 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.530+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:56.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.530+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.542+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T13:33:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.542+0000 7f34c8fe8ec0 20 zonegroup default 2019-11-27T13:33:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.542+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.551+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.551+0000 7f34c8fe8ec0 10 Cannot find current period zone using local zone 2019-11-27T13:33:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.551+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.560+0000 7f34c8fe8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T13:33:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.560+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.575+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T13:33:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.575+0000 7f34c8fe8ec0 20 rados->read ofs=0 len=0 2019-11-27T13:33:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.603+0000 7f34c8fe8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T13:33:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.603+0000 7f34c8fe8ec0 20 zone default found 2019-11-27T13:33:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.603+0000 7f34c8fe8ec0 20 started sync module instance, tier type = 2019-11-27T13:33:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.603+0000 7f34c8fe8ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T13:33:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.976+0000 7f34c8fe8ec0 20 add_watcher() i=0 2019-11-27T13:33:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.977+0000 7f34c8fe8ec0 20 add_watcher() i=1 2019-11-27T13:33:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.977+0000 7f34c8fe8ec0 20 add_watcher() i=2 2019-11-27T13:33:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.977+0000 7f34c8fe8ec0 20 add_watcher() i=3 2019-11-27T13:33:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.977+0000 7f34c8fe8ec0 20 add_watcher() i=4 2019-11-27T13:33:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.977+0000 7f34c8fe8ec0 20 add_watcher() i=5 2019-11-27T13:33:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:56.977+0000 7f34c8fe8ec0 20 add_watcher() i=6 2019-11-27T13:33:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:57.008+0000 7f34c8fe8ec0 20 add_watcher() i=7 2019-11-27T13:33:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:57.008+0000 7f34c8fe8ec0 2 all 8 watchers are set, enabling cache 2019-11-27T13:33:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:57.009+0000 7f3485feb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T13:33:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:57.031+0000 7f34b6a16700 0 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x560286464b20 msgr2=0x560286461f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:33:57.185 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:57.189+0000 7f34b6a16700 0 -- 172.21.15.5:0/2457102457 >> [v2:172.21.15.115:6800/9159,v1:172.21.15.115:6801/9159] conn(0x5602864b1140 msgr2=0x5602864b3560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T13:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.569+0000 7f33f7fff700 20 reqs_thread_entry: start 2019-11-27T13:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.569+0000 7f33f5ffb700 20 reqs_thread_entry: start 2019-11-27T13:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.570+0000 7f34c8fe8ec0 20 init_complete bucket index max shards: 0 2019-11-27T13:33:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.570+0000 7f33e3fff700 20 reqs_thread_entry: start 2019-11-27T13:33:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.571+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T13:33:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.612+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:58.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.628+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.637+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.672+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T13:33:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.752+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.779+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:58.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.792+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.840+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T13:33:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.887+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.905+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:58.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.913+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:58.949 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:58.953+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T13:33:58.999 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.003+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.025+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:59.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.040+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.087+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T13:33:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.178+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.200 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.204+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.221+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.266+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T13:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.317+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.339+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.347+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.377+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T13:33:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.441+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.461 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.465+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:59.474 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.478+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.514 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.518+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T13:33:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.618+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.646+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.660+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.744+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T13:33:59.810 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.814+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.845+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:33:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.864+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:33:59.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.919+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T13:33:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:33:59.985+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.009+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:00.022 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.026+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.058 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.061+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T13:34:00.103 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.107+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.125+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.132+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.164+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T13:34:00.223 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.226+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.252+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.266+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.316+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T13:34:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.374+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.388 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.392+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:00.398 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.402+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.451+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T13:34:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.535+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.561+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.577+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.624+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T13:34:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.709+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.735+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:00.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.747+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.783+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T13:34:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.844+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.864+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.873+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.910+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T13:34:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.957+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.975+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:00.984+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.018+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T13:34:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.075+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.099+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.113 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.117+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.159 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.163+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T13:34:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.214+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.230+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.243+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.281+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T13:34:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.360+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.411+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.438+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.498+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T13:34:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.542+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.563+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.572+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.612+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T13:34:01.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.665+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.692 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.696+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.714+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.753+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T13:34:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.828+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.847+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.857+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.895+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T13:34:01.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.946+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.984+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:01.996+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.036+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T13:34:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.081+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.098+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:02.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.106+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.148+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T13:34:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.218+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.236+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.243+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.278 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.282+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T13:34:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.347+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.370+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.381+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.429+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T13:34:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.545+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.572+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.585+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.619 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.623+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T13:34:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.700+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.735+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.749+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.822+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T13:34:02.888 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.892+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.916+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.928+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:02.973+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T13:34:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.047+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:03.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.069+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:03.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.082+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.119+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T13:34:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.158+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.174+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T13:34:03.178 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.182+0000 7f34c8fe8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T13:34:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.271+0000 7f34c8fe8ec0 20 remove_watcher() i=0 2019-11-27T13:34:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.271+0000 7f34c8fe8ec0 2 removed watcher, disabling cache 2019-11-27T13:34:03.328 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.332+0000 7f34c8fe8ec0 20 remove_watcher() i=1 2019-11-27T13:34:03.363 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.367+0000 7f34c8fe8ec0 20 remove_watcher() i=2 2019-11-27T13:34:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.425+0000 7f34c8fe8ec0 20 remove_watcher() i=3 2019-11-27T13:34:03.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.471+0000 7f34c8fe8ec0 20 remove_watcher() i=4 2019-11-27T13:34:03.532 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.535+0000 7f34c8fe8ec0 20 remove_watcher() i=5 2019-11-27T13:34:03.591 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.595+0000 7f34c8fe8ec0 20 remove_watcher() i=6 2019-11-27T13:34:03.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T13:34:03.644+0000 7f34c8fe8ec0 20 remove_watcher() i=7 2019-11-27T13:34:03.649 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-11-27T13:34:04.307 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :clean 2019-11-27T13:34:04.803 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :compileJava 2019-11-27T13:34:04.803 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :processResources 2019-11-27T13:34:04.804 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :classes 2019-11-27T13:34:05.004 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :compileTestJava 2019-11-27T13:34:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-27T13:34:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-27T13:34:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :processTestResources NO-SOURCE 2019-11-27T13:34:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :testClasses 2019-11-27T13:34:07.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:07.903 INFO:teuthology.orchestra.run.smithi005.stdout:> Task :test 2019-11-27T13:34:07.904 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:07.904 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-11-27T13:34:13.603 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:13.604 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-11-27T13:34:28.203 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:33.399 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-11-27T13:34:33.400 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:33.400 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-11-27T13:34:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:38.703 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-11-27T13:34:43.203 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:43.203 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-11-27T13:34:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:34:51.503 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-11-27T13:35:31.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:35:31.524 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-11-27T13:35:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:35:38.204 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-11-27T13:35:42.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:35:42.003 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-11-27T13:35:51.114 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:35:51.115 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-11-27T13:35:56.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:35:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-11-27T13:36:04.202 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:04.203 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-11-27T13:36:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:04.903 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-11-27T13:36:05.802 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:05.803 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-11-27T13:36:07.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:07.602 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-11-27T13:36:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:14.102 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-11-27T13:36:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:26.321 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-11-27T13:36:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:26.322 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-11-27T13:36:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:29.202 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-11-27T13:36:35.902 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:35.902 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-11-27T13:36:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:39.406 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-11-27T13:36:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:48.102 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-11-27T13:36:48.332 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:42:22.401 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.337 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:42:22.407 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.343 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:42:22.413 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.352 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:42:22.362 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.352 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:42:22.422 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.364 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:42:22.374 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.533 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:42:22.603 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.566 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:42:22.636 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:48.584 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:42:22.594 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:49.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:49.302 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-11-27T13:36:54.416 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:42:28.486 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.428 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:42:28.498 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.446 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:42:28.516 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.476 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:42:28.546 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.483 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:42:28.553 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.486 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:42:28.496 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.488 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:42:28.498 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.501 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:42:28.571 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.506 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:42:28.516 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:36:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:54.602 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-11-27T13:36:57.402 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:36:57.402 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-11-27T13:37:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:03.602 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-11-27T13:37:05.501 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:05.502 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-11-27T13:37:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:11.002 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-11-27T13:37:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:13.002 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-11-27T13:37:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:19.401 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-11-27T13:37:25.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:25.702 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-11-27T13:37:31.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:31.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-11-27T13:37:50.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:37:50.101 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-11-27T13:38:07.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:38:07.201 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-11-27T13:41:32.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:41:32.002 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-11-27T13:41:48.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:41:48.201 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-11-27T13:41:51.301 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:41:51.301 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-11-27T13:41:58.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:41:58.101 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-11-27T13:42:00.308 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:47:34.378 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.315 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:47:34.385 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.326 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:47:34.336 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.331 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:47:34.341 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.332 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:47:34.403 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.340 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:47:34.410 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:47:34.590 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.535 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:47:34.606 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:00.574 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:47:34.584 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:42:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:42:02.201 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-11-27T13:42:14.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:42:14.901 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-11-27T13:42:43.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:42:43.001 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-11-27T13:42:50.000 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:42:50.001 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-11-27T13:42:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:42:50.201 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-11-27T13:42:51.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:42:51.301 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-11-27T13:43:20.391 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T13:43:20.389+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-27T13:43:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:43:21.301 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-11-27T13:43:29.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:43:29.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-11-27T13:44:01.499 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:44:01.500 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-11-27T13:44:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:44:15.900 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-11-27T13:44:38.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:44:38.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-11-27T13:44:46.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:44:46.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-11-27T13:45:15.807 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:50:49.880 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.819 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:50:49.893 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.855 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:50:49.865 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.861 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:50:49.871 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.878 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:50:49.951 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.882 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:50:49.955 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.915 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:50:49.989 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.964 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:50:49.975 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:45:15.991 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:50:50.064 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.541 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:52:44.616 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.548 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:52:44.623 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.563 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:52:44.638 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.566 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:52:44.642 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.568 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:52:44.579 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.608 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:52:44.618 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.654 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:52:44.729 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.670 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:52:44.746 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:10.832 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:52:44.842 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:47:31.396 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:47:31.396 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-11-27T13:47:38.397 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:47:38.397 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-11-27T13:48:04.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:48:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-11-27T13:48:10.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:48:10.497 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-11-27T13:48:37.198 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:48:37.198 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-11-27T13:48:43.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:48:43.598 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-11-27T13:48:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:48:53.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-11-27T13:49:12.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:49:12.599 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-11-27T13:49:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:49:12.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-11-27T13:49:13.399 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:49:13.399 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-11-27T13:49:14.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:49:14.199 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-11-27T13:49:17.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:49:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-11-27T13:49:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:49:20.499 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-11-27T13:50:28.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:28.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-11-27T13:50:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:30.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-11-27T13:50:38.000 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:38.000 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-11-27T13:50:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:40.201 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-11-27T13:50:46.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:46.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-11-27T13:50:48.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:48.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-11-27T13:50:56.000 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:56.382 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-11-27T13:50:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:50:58.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-11-27T13:51:04.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:04.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-11-27T13:51:07.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:07.100 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-11-27T13:51:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:16.400 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-11-27T13:51:22.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:22.500 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-11-27T13:51:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:34.300 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-11-27T13:51:40.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:40.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-11-27T13:51:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:51:52.500 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-11-27T13:52:00.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:00.500 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-11-27T13:52:13.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:13.900 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-11-27T13:52:22.168 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:57:56.240 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.176 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:57:56.248 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.182 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:57:56.192 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.185 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:57:56.196 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.190 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:57:56.261 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.193 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:57:56.265 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.200 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:22.200 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-11-27T13:52:22.357 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:57:56.367 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.371 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:57:56.443 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:22.386 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:57:56.458 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:52:33.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:33.500 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-11-27T13:52:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-11-27T13:52:50.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:50.900 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-11-27T13:52:57.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:52:57.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-11-27T13:53:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:53:12.200 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-11-27T13:53:19.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:53:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-11-27T13:53:31.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:53:31.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-11-27T13:53:37.305 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:59:11.377 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.311 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:59:11.383 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.349 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:59:11.420 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.357 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:59:11.367 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.359 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:59:11.369 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.364 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:59:11.436 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.407 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:59:11.479 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.423 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:59:11.495 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:37.440 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:00:59:11.450 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:53:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:53:39.200 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-11-27T13:53:50.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:53:50.700 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-11-27T13:53:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:53:56.800 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-11-27T13:54:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:54:08.500 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-11-27T13:54:16.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:54:16.700 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-11-27T13:54:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:54:29.100 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-11-27T13:54:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:54:36.900 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-11-27T13:54:48.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:54:48.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-11-27T13:54:56.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:54:56.199 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-11-27T13:55:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:55:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-11-27T13:55:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:55:14.699 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-11-27T13:55:24.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:55:24.999 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-11-27T13:55:32.699 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:55:32.699 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-11-27T13:55:44.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:55:44.599 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-11-27T13:55:51.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:55:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-11-27T13:56:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:02.399 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-11-27T13:56:10.299 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:10.299 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-11-27T13:56:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:22.599 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-11-27T13:56:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:27.799 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-11-27T13:56:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:37.599 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-11-27T13:56:43.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:43.199 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-11-27T13:56:56.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:56:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-11-27T13:57:00.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:00.999 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-11-27T13:57:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:11.000 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-11-27T13:57:17.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:17.100 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-11-27T13:57:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:26.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-11-27T13:57:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:29.900 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-11-27T13:57:33.094 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:03:07.166 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.100 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:03:07.172 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.111 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:03:07.183 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.114 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:03:07.124 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.117 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:03:07.189 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.118 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:03:07.128 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.257 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:03:07.328 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.285 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:03:07.357 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:33.318 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:03:07.328 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T13:57:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:39.100 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-11-27T13:57:44.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:44.900 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-11-27T13:57:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:54.600 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-11-27T13:57:56.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:57:56.901 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-11-27T13:58:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:02.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-11-27T13:58:06.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:06.601 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-11-27T13:58:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:14.301 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-11-27T13:58:17.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:28.291 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-11-27T13:58:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:28.292 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-11-27T13:58:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:30.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-11-27T13:58:37.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:37.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-11-27T13:58:46.301 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-11-27T13:58:52.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:52.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-11-27T13:58:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-11-27T13:58:53.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:53.701 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-11-27T13:58:57.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:58:57.701 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-11-27T13:59:05.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:05.601 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-11-27T13:59:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:08.501 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-11-27T13:59:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:15.701 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-11-27T13:59:17.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-11-27T13:59:24.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:24.401 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-11-27T13:59:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:26.401 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-11-27T13:59:34.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:34.001 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-11-27T13:59:37.301 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:37.301 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-11-27T13:59:45.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:45.701 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-11-27T13:59:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T13:59:58.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-11-27T14:00:06.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:00:06.701 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-11-27T14:00:18.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:00:18.801 INFO:teuthology.orchestra.run.smithi005.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-11-27T14:00:28.459 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:00:28.459 INFO:teuthology.orchestra.run.smithi005.stdout:---------------------------------------------------------------------- 2019-11-27T14:00:28.459 INFO:teuthology.orchestra.run.smithi005.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-11-27T14:00:28.460 INFO:teuthology.orchestra.run.smithi005.stdout:---------------------------------------------------------------------- 2019-11-27T14:00:28.460 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:00:28.460 INFO:teuthology.orchestra.run.smithi005.stdout:BUILD SUCCESSFUL in 26m 24s 2019-11-27T14:00:28.460 INFO:teuthology.orchestra.run.smithi005.stdout:5 actionable tasks: 5 executed 2019-11-27T14:00:28.475 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T14:00:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.631+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.661+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.661+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.672+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.667 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.672+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.682+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.682+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.705+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.891+0000 7f5eca43eec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:00:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.891+0000 7f5eca43eec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:00:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.891+0000 7f5eca43eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:00:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.891+0000 7f5eca43eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:00:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.891+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.894 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.900+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:28.895 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.900+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.913+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.913+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.922+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.922+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.939+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:28.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.939+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.939 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.945+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.939 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.945+0000 7f5eca43eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:00:28.940 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.945+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.952+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.952+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.958 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.964+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:28.959 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.964+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.979+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.979+0000 7f5eca43eec0 20 zonegroup default 2019-11-27T14:00:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.979+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.985+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.985+0000 7f5eca43eec0 10 Cannot find current period zone using local zone 2019-11-27T14:00:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.985+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.991+0000 7f5eca43eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.991+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.999+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:28.999+0000 7f5eca43eec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.008+0000 7f5eca43eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.008+0000 7f5eca43eec0 20 zone default found 2019-11-27T14:00:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.008+0000 7f5eca43eec0 20 started sync module instance, tier type = 2019-11-27T14:00:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.008+0000 7f5eca43eec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:00:29.304 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.310+0000 7f5eca43eec0 20 add_watcher() i=0 2019-11-27T14:00:29.304 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.310+0000 7f5eca43eec0 20 add_watcher() i=1 2019-11-27T14:00:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.310+0000 7f5eca43eec0 20 add_watcher() i=2 2019-11-27T14:00:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.310+0000 7f5eca43eec0 20 add_watcher() i=3 2019-11-27T14:00:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.310+0000 7f5eca43eec0 20 add_watcher() i=4 2019-11-27T14:00:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.310+0000 7f5eca43eec0 20 add_watcher() i=5 2019-11-27T14:00:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.316+0000 7f5eca43eec0 20 add_watcher() i=6 2019-11-27T14:00:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.344+0000 7f5eca43eec0 20 add_watcher() i=7 2019-11-27T14:00:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.344+0000 7f5eca43eec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:00:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.344+0000 7f5e87fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:00:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.350+0000 7f5eb6e6a700 0 -- 172.21.15.5:0/770095266 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x559ae3e8ee80 msgr2=0x559ae3eb74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T14:00:29.546 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.552+0000 7f5eb6e6a700 0 --2- 172.21.15.5:0/770095266 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x559ae3e8ee80 0x559ae3eb74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T14:00:29.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:29.609+0000 7f5eb766b700 0 -- 172.21.15.5:0/639010744 >> [v2:172.21.15.115:6824/9158,v1:172.21.15.115:6825/9158] conn(0x559ae3ec47c0 msgr2=0x559ae3ec6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:00:31.636 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.642+0000 7f5df67fc700 20 reqs_thread_entry: start 2019-11-27T14:00:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.642+0000 7f5deffff700 20 reqs_thread_entry: start 2019-11-27T14:00:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.642+0000 7f5eca43eec0 20 init_complete bucket index max shards: 0 2019-11-27T14:00:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.643+0000 7f5dee7fc700 20 reqs_thread_entry: start 2019-11-27T14:00:31.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.643+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T14:00:31.833 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.839+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.877+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.912+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.912+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1079', time=2019-11-27T15:40:31.650043+0000, chain.objs.size()=9 2019-11-27T14:00:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.1 2019-11-27T14:00:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.1_1 2019-11-27T14:00:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.2 2019-11-27T14:00:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.2_1 2019-11-27T14:00:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.3 2019-11-27T14:00:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.3_1 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.4 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.4_1 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~_hilY67Ei64zOFiIFxrxz2FEw1VtuDG.5 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1238', time=2019-11-27T15:47:03.668115+0000, chain.objs.size()=9 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.1 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.1_1 2019-11-27T14:00:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.913+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.2 2019-11-27T14:00:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:31.990+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.2_1 2019-11-27T14:00:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.161+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.3 2019-11-27T14:00:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.161+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.3_1 2019-11-27T14:00:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.161+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.4 2019-11-27T14:00:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.161+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.4_1 2019-11-27T14:00:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.161+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~J4KUSmWHWC1YiGOPX3wEJpj29z2rQgb.5 2019-11-27T14:00:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.376+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:32.456 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.462+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T14:00:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.511+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.528+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1248', time=2019-11-27T15:47:29.632662+0000, chain.objs.size()=7 2019-11-27T14:00:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.1 2019-11-27T14:00:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.1_1 2019-11-27T14:00:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.1_2 2019-11-27T14:00:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.2 2019-11-27T14:00:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.2_1 2019-11-27T14:00:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.2_2 2019-11-27T14:00:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.539+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~b2aq8_0fFtuBoBmhXQxhUIstDuWB48z.3 2019-11-27T14:00:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.696+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.798+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T14:00:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.848+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.870+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.883+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.924+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T14:00:32.989 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:32.994+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:33.016 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.022+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1161', time=2019-11-27T15:43:23.569405+0000, chain.objs.size()=9 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__multipart_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.1 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__shadow_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.1_1 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__multipart_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.2 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__shadow_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.2_1 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__multipart_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.3 2019-11-27T14:00:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__shadow_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.3_1 2019-11-27T14:00:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__multipart_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.4 2019-11-27T14:00:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__shadow_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.4_1 2019-11-27T14:00:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.039+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.72__multipart_key1.2~CmHCmYRBlDDbHaniLvEugBPIlm9oMPG.5 2019-11-27T14:00:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.295+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.391+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T14:00:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.476+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:33.519 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.525+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1063', time=2019-11-27T15:41:34.824413+0000, chain.objs.size()=5 2019-11-27T14:00:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.66__shadow_.Vaih3_Brfjg3CfTmT_3o1bUAlzy2GxQ_1 2019-11-27T14:00:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.66__shadow_.Vaih3_Brfjg3CfTmT_3o1bUAlzy2GxQ_2 2019-11-27T14:00:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.66__shadow_.Vaih3_Brfjg3CfTmT_3o1bUAlzy2GxQ_3 2019-11-27T14:00:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.66__shadow_.Vaih3_Brfjg3CfTmT_3o1bUAlzy2GxQ_4 2019-11-27T14:00:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.540+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.66__shadow_.Vaih3_Brfjg3CfTmT_3o1bUAlzy2GxQ_5 2019-11-27T14:00:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:33.768 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.774+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T14:00:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.845+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.867+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.878+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:33.917 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:33.923+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T14:00:33.994 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.000+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.030+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1087', time=2019-11-27T15:40:56.010740+0000, chain.objs.size()=9 2019-11-27T14:00:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.1 2019-11-27T14:00:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.1_1 2019-11-27T14:00:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.2 2019-11-27T14:00:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.2_1 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.3 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.3_1 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.4 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.4_1 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~6arI0vGzoDdmx9rpbUrv_93l2MFubes.5 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1193', time=2019-11-27T15:44:03.508704+0000, chain.objs.size()=9 2019-11-27T14:00:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.1 2019-11-27T14:00:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.1_1 2019-11-27T14:00:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.064+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.2 2019-11-27T14:00:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.258+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.2_1 2019-11-27T14:00:34.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.324+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.3 2019-11-27T14:00:34.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.324+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.3_1 2019-11-27T14:00:34.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.324+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.4 2019-11-27T14:00:34.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.324+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.4_1 2019-11-27T14:00:34.319 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.324+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file.mpg.2~neVuULo3ZjQIIwRvjhgIkI68sqTJh6b.5 2019-11-27T14:00:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.430+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.511+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T14:00:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.590+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.622+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1099', time=2019-11-27T15:41:31.068140+0000, chain.objs.size()=7 2019-11-27T14:00:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.1 2019-11-27T14:00:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.1_1 2019-11-27T14:00:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.1_2 2019-11-27T14:00:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.2 2019-11-27T14:00:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.2_1 2019-11-27T14:00:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.2_2 2019-11-27T14:00:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~ch_X1HytDyb2PSCUlgaTZKI5YgDg_Jo.3 2019-11-27T14:00:34.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.775+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.851+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T14:00:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.899+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.920+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1048', time=2019-11-27T15:38:00.395150+0000, chain.objs.size()=9 2019-11-27T14:00:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.1 2019-11-27T14:00:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.1_1 2019-11-27T14:00:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.2 2019-11-27T14:00:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.2_1 2019-11-27T14:00:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.3 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.3_1 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.4 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.940+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.4_1 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.941+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.5 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.941+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1268', time=2019-11-27T15:48:05.894085+0000, chain.objs.size()=9 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.941+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__multipart_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.1 2019-11-27T14:00:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.941+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__shadow_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.1_1 2019-11-27T14:00:34.938 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.941+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__multipart_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.2 2019-11-27T14:00:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:34.999+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__shadow_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.2_1 2019-11-27T14:00:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.078+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__multipart_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.3 2019-11-27T14:00:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.078+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__shadow_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.3_1 2019-11-27T14:00:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.078+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__multipart_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.4 2019-11-27T14:00:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.078+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__shadow_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.4_1 2019-11-27T14:00:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.078+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.76__multipart_key1.2~nZb6hqCMi4J8229i4xdO2Kp0-dhsFUw.5 2019-11-27T14:00:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.241+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:35.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.349+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T14:00:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.396+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.424+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1919', time=2019-11-27T16:00:21.601075+0000, chain.objs.size()=9 2019-11-27T14:00:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__multipart_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.1 2019-11-27T14:00:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__shadow_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.1_1 2019-11-27T14:00:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__multipart_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.2 2019-11-27T14:00:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__shadow_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.2_1 2019-11-27T14:00:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__multipart_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.3 2019-11-27T14:00:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__shadow_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.3_1 2019-11-27T14:00:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__multipart_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.4 2019-11-27T14:00:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__shadow_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.4_1 2019-11-27T14:00:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.119__multipart_key1/data/file.mpg.2~0zZ-2Nn-GIiwMAwTTjWiF_Ln04OcPse.5 2019-11-27T14:00:35.675 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.680+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.785+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T14:00:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.837+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:35.852 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.858+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1071', time=2019-11-27T15:39:43.549220+0000, chain.objs.size()=9 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.1 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.1_1 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.2 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.2_1 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.3 2019-11-27T14:00:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.3_1 2019-11-27T14:00:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.4 2019-11-27T14:00:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.4_1 2019-11-27T14:00:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:35.877+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~j6zmxSVL6eylpFUQp2gJ2Fb1k3PG7OI.5 2019-11-27T14:00:36.098 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.104+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.308+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T14:00:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.358+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.376+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:36.379 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.384+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.418+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T14:00:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.473+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.497+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.519+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.519+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1093', time=2019-11-27T15:41:14.989210+0000, chain.objs.size()=7 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.519+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.1 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.519+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.1_1 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.519+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.1_2 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.519+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.2 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.2_1 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.2_2 2019-11-27T14:00:36.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~dix9VoCMLdPp6zxSk9k5uMWpVbpSrSR.3 2019-11-27T14:00:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1142', time=2019-11-27T15:42:45.802270+0000, chain.objs.size()=9 2019-11-27T14:00:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__multipart_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.1 2019-11-27T14:00:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__shadow_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.1_1 2019-11-27T14:00:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__multipart_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.2 2019-11-27T14:00:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__shadow_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.2_1 2019-11-27T14:00:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.520+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__multipart_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.3 2019-11-27T14:00:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.674+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__shadow_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.3_1 2019-11-27T14:00:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.727+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__multipart_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.4 2019-11-27T14:00:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.727+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__shadow_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.4_1 2019-11-27T14:00:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.766+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.71__multipart_key1.2~BxHKIrDsNS5m4sAa_eL8bLvZ0X784Ky.5 2019-11-27T14:00:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:36.892+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.068+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T14:00:37.126 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.132+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.161+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:37.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:37.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1903', time=2019-11-27T16:00:01.459745+0000, chain.objs.size()=9 2019-11-27T14:00:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__multipart_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.1 2019-11-27T14:00:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__shadow_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.1_1 2019-11-27T14:00:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__multipart_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.2 2019-11-27T14:00:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__shadow_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.2_1 2019-11-27T14:00:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__multipart_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.3 2019-11-27T14:00:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__shadow_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.3_1 2019-11-27T14:00:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__multipart_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.4 2019-11-27T14:00:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__shadow_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.4_1 2019-11-27T14:00:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.179+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.118__multipart_key1.2~edayiiGkkizH9Uhuooc_TPUAaoOjgF3.5 2019-11-27T14:00:37.439 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.445+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.606+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T14:00:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.663+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.678+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1105', time=2019-11-27T15:41:42.251766+0000, chain.objs.size()=7 2019-11-27T14:00:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.1 2019-11-27T14:00:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.1_1 2019-11-27T14:00:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.1_2 2019-11-27T14:00:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.2 2019-11-27T14:00:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.2_1 2019-11-27T14:00:37.688 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__shadow_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.2_2 2019-11-27T14:00:37.688 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.692+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.67__multipart_key1.2~5q1VpGC-mahgfR1D1ijI9xcz5W6b4b8.3 2019-11-27T14:00:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.834+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.906+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T14:00:37.945 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.951+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.970+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:37.972 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:37.978+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.047+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T14:00:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.107+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.131+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.152+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.187+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T14:00:38.233 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.239+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.251 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.256+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.268+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.306+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T14:00:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.349+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.368+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.381+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.414+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T14:00:38.457 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.463+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.481+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.489+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.524+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T14:00:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.564+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.600+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.610+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.668+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T14:00:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.715+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:38.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.731+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1231', time=2019-11-27T15:46:31.071155+0000, chain.objs.size()=9 2019-11-27T14:00:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.1 2019-11-27T14:00:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.1_1 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.2 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.2_1 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.3 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.3_1 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.4 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.4_1 2019-11-27T14:00:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.743+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~swsA-CBInl7Dn98RyBMz-17tEb0K368.5 2019-11-27T14:00:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.916+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:38.997+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T14:00:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.038+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.054+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J', time=2019-11-27T15:44:42.744876+0000, chain.objs.size()=9 2019-11-27T14:00:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__multipart_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.7 2019-11-27T14:00:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__shadow_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.7_1 2019-11-27T14:00:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__multipart_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.8 2019-11-27T14:00:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__shadow_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.8_1 2019-11-27T14:00:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__multipart_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.9 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__shadow_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.9_1 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__multipart_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.10 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__shadow_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.10_1 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.74__multipart_key1.2~cRl2bFfudrghun3Ht8xLBkDHDQqjY8J.11 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.072+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1243', time=2019-11-27T15:47:15.674261+0000, chain.objs.size()=7 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.073+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.1 2019-11-27T14:00:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.073+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.1_1 2019-11-27T14:00:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.073+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.1_2 2019-11-27T14:00:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.290+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.2 2019-11-27T14:00:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.290+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.2_1 2019-11-27T14:00:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.291+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.2_2 2019-11-27T14:00:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.291+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~cef8RjNfWn1HqjcqcrsDDf5e6OqjXKe.3 2019-11-27T14:00:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.433+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:39.527 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.533+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T14:00:39.567 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.573+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.595+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1253', time=2019-11-27T15:47:33.325837+0000, chain.objs.size()=7 2019-11-27T14:00:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.1 2019-11-27T14:00:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.1_1 2019-11-27T14:00:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.1_2 2019-11-27T14:00:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.2 2019-11-27T14:00:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.2_1 2019-11-27T14:00:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.2_2 2019-11-27T14:00:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.606+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~OJLXFXNQt3CWNuDIKoM_pHqdpCdnHJ4.3 2019-11-27T14:00:39.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.857+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:39.943 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:39.949+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T14:00:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.007+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:40.028 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.034+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:40.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T14:00:40.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1050', time=2019-11-27T15:37:52.375045+0000, chain.objs.size()=9 2019-11-27T14:00:40.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.1 2019-11-27T14:00:40.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.1_1 2019-11-27T14:00:40.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.2 2019-11-27T14:00:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.2_1 2019-11-27T14:00:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.3 2019-11-27T14:00:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.3_1 2019-11-27T14:00:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.4 2019-11-27T14:00:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__shadow_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.4_1 2019-11-27T14:00:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.059+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.64__multipart_key1.2~ACjo6KeCuP-LNp1FJu7nGZHzda7eeZE.5 2019-11-27T14:00:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.221+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:40.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.300+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T14:00:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.357+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:40.374 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.379+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.390+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.426+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T14:00:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.493+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.511+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.521+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.565+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T14:00:40.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.632+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.689+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:40.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:40.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT', time=2019-11-27T15:35:30.305412+0000, chain.objs.size()=9 2019-11-27T14:00:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__multipart_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.1 2019-11-27T14:00:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__shadow_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.1_1 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__multipart_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.2 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__shadow_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.2_1 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__multipart_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.3 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__shadow_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.3_1 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__multipart_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.4 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__shadow_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.4_1 2019-11-27T14:00:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.52__multipart_key1.2~ryqSFCKmpHVdXyuZhyv44eETaroW1yT.5 2019-11-27T14:00:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1192', time=2019-11-27T15:44:07.312056+0000, chain.objs.size()=9 2019-11-27T14:00:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.1 2019-11-27T14:00:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.1_1 2019-11-27T14:00:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.718+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.2 2019-11-27T14:00:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.901+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.2_1 2019-11-27T14:00:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.901+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.3 2019-11-27T14:00:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.901+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.3_1 2019-11-27T14:00:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.901+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.4 2019-11-27T14:00:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.901+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__shadow_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.4_1 2019-11-27T14:00:40.939 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:40.945+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.73__multipart_file2.mpg.2~4e5PM5JodJpju05geoKVnJyEZgusYbL.5 2019-11-27T14:00:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.036+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.117+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T14:00:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.158+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.178+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.188+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.237+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T14:00:41.288 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.294+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.315+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.979', time=2019-11-27T15:36:22.355267+0000, chain.objs.size()=2 2019-11-27T14:00:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.56__shadow_.e9jIWQrpJgmFvTRTBkYZ5lpqdsLtFJH_1 2019-11-27T14:00:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.56__shadow_.e9jIWQrpJgmFvTRTBkYZ5lpqdsLtFJH_2 2019-11-27T14:00:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK', time=2019-11-27T15:49:07.584254+0000, chain.objs.size()=37 2019-11-27T14:00:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.1 2019-11-27T14:00:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.2 2019-11-27T14:00:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.3 2019-11-27T14:00:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.4 2019-11-27T14:00:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.355+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.5 2019-11-27T14:00:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.356+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.6 2019-11-27T14:00:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.356+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.7 2019-11-27T14:00:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.356+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.8 2019-11-27T14:00:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.356+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.9 2019-11-27T14:00:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.356+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.10 2019-11-27T14:00:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.554+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.11 2019-11-27T14:00:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.570+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.12 2019-11-27T14:00:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.576+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.13 2019-11-27T14:00:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.577+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.14 2019-11-27T14:00:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.600+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.7iGmK3uJ1j0iyetcov7UY1OC_bL2Kps.15 2019-11-27T14:00:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.601+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.4-RGcF3ebRYzJQOj7YskiBqTu7AZMe5.16 2019-11-27T14:00:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.601+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.p_LVYHkKxj0aGE0MdFQz5rYm28UJRER.17 2019-11-27T14:00:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.601+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.8q3e5r_OEA28cQ9ORJ9BtfHdRwB_bQN.18 2019-11-27T14:00:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.601+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.EiLgC14tD2V-_2jzC9QEcCUgBRSbEHk.19 2019-11-27T14:00:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.629+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.bf1W4p8QYZ89e99hRSupEkh8MbcUb6x.20 2019-11-27T14:00:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.629+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.21 2019-11-27T14:00:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.741+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.22 2019-11-27T14:00:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.802+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.23 2019-11-27T14:00:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.806+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.24 2019-11-27T14:00:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.806+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.25 2019-11-27T14:00:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.907+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.26 2019-11-27T14:00:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.907+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.27 2019-11-27T14:00:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.907+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.28 2019-11-27T14:00:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.29 2019-11-27T14:00:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.30 2019-11-27T14:00:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.31 2019-11-27T14:00:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.32 2019-11-27T14:00:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.33 2019-11-27T14:00:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.34 2019-11-27T14:00:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.35 2019-11-27T14:00:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:41.973+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.36 2019-11-27T14:00:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.003+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.78__multipart_key1.2~5z2x69Rkg-fAcVJLZZ3jgho-W4-X6HK.37 2019-11-27T14:00:42.236 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.242+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.349+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.410+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.444+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.460+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.513+0000 7f5eca43eec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T14:00:42.578 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.584+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:42.608 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.613+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T14:00:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1224', time=2019-11-27T15:45:51.014828+0000, chain.objs.size()=9 2019-11-27T14:00:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.1 2019-11-27T14:00:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.1_1 2019-11-27T14:00:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.2 2019-11-27T14:00:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.2_1 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.3 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.642+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.3_1 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.4 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__shadow_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.4_1 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.75__multipart_key1.2~do9AcCieQYNvnSyUBBpxk0TLLhhEiIE.5 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 20 garbage collection: RGWGC::process iterating over entry tag='dc4084cb-262b-4d5b-9664-fa175bfdb24a.4361.1283', time=2019-11-27T15:48:39.390115+0000, chain.objs.size()=9 2019-11-27T14:00:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__multipart_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.1 2019-11-27T14:00:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__shadow_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.1_1 2019-11-27T14:00:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.643+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__multipart_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.2 2019-11-27T14:00:42.826 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.832+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__shadow_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.2_1 2019-11-27T14:00:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.832+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__multipart_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.3 2019-11-27T14:00:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.876+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__shadow_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.3_1 2019-11-27T14:00:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.880+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__multipart_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.4 2019-11-27T14:00:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.880+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__shadow_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.4_1 2019-11-27T14:00:42.975 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:42.980+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.77__multipart_key1.2~KyZ2gshnA69Fidqd5h8bn8aNwuhresx.5 2019-11-27T14:00:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.127+0000 7f5eca43eec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T14:00:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.338+0000 7f5eca43eec0 20 remove_watcher() i=0 2019-11-27T14:00:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.338+0000 7f5eca43eec0 2 removed watcher, disabling cache 2019-11-27T14:00:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.404+0000 7f5eca43eec0 20 remove_watcher() i=1 2019-11-27T14:00:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.471+0000 7f5eca43eec0 20 remove_watcher() i=2 2019-11-27T14:00:43.508 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.514+0000 7f5eca43eec0 20 remove_watcher() i=3 2019-11-27T14:00:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.568+0000 7f5eca43eec0 20 remove_watcher() i=4 2019-11-27T14:00:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.605+0000 7f5eca43eec0 20 remove_watcher() i=5 2019-11-27T14:00:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.646+0000 7f5eca43eec0 20 remove_watcher() i=6 2019-11-27T14:00:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.687+0000 7f5eca43eec0 20 remove_watcher() i=7 2019-11-27T14:00:43.691 INFO:teuthology.orchestra.run.smithi005:> radosgw-admin gc process --include-all 2019-11-27T14:00:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.823+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.848+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.848+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.856+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.856+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.866+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.866+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:43.884+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.106+0000 7fdf29f8dec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:00:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.106+0000 7fdf29f8dec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:00:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.106+0000 7fdf29f8dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:00:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.106+0000 7fdf29f8dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:00:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.107+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.116+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.116+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.129+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.129+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.137 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.143+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.143+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.157+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.157+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.164+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.164+0000 7fdf29f8dec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:00:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.164+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.173+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.173+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.187+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.187+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.199+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.199+0000 7fdf29f8dec0 20 zonegroup default 2019-11-27T14:00:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.199+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.206+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:44.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.206+0000 7fdf29f8dec0 10 Cannot find current period zone using local zone 2019-11-27T14:00:44.201 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.206+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.215+0000 7fdf29f8dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.215+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.229+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.229+0000 7fdf29f8dec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.247+0000 7fdf29f8dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.247+0000 7fdf29f8dec0 20 zone default found 2019-11-27T14:00:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.247+0000 7fdf29f8dec0 20 started sync module instance, tier type = 2019-11-27T14:00:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.247+0000 7fdf29f8dec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:00:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf171ba700 0 -- 172.21.15.5:0/959324176 >> [v2:172.21.15.5:6818/10045,v1:172.21.15.5:6819/10045] conn(0x7fdf10006690 msgr2=0x7fdf10006aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:00:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=0 2019-11-27T14:00:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=1 2019-11-27T14:00:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=2 2019-11-27T14:00:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=3 2019-11-27T14:00:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=4 2019-11-27T14:00:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=5 2019-11-27T14:00:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.657+0000 7fdf29f8dec0 20 add_watcher() i=6 2019-11-27T14:00:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.701+0000 7fdf29f8dec0 20 add_watcher() i=7 2019-11-27T14:00:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.701+0000 7fdf29f8dec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:00:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.701+0000 7fdee7fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:00:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:44.728+0000 7fdf169b9700 0 -- 172.21.15.5:0/1947831694 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55fd6e341e90 msgr2=0x55fd6e324fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:00:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.249+0000 7fde567fc700 20 reqs_thread_entry: start 2019-11-27T14:00:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.249+0000 7fde54ff9700 20 reqs_thread_entry: start 2019-11-27T14:00:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.249+0000 7fdf29f8dec0 20 init_complete bucket index max shards: 0 2019-11-27T14:00:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.250+0000 7fde4effd700 20 reqs_thread_entry: start 2019-11-27T14:00:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.250+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T14:00:46.324 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.330+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.357+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.370+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.420+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T14:00:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.488+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.521+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.535+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.590 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.595+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T14:00:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.651+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.671+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.682+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.720 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.726+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T14:00:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.808+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.838+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.853+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.890+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T14:00:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.945+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:46.959 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.965+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:46.974+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.016+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T14:00:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.073+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.087 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.093+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.103+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.144+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T14:00:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.220+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.254+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.263 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.269+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.298 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.304+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T14:00:47.376 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.381+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.406 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.412+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.427+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.465+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T14:00:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.511+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.527+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.528 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.534+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.570+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T14:00:47.602 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.608+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.625+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.633+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.669+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T14:00:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.709+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.727+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.735+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.767+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T14:00:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.815+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.841+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:47.848 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.854+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.910+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T14:00:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:47.996+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.016 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.021+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.036+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.082+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T14:00:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.161+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.191+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.208+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.265+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T14:00:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.348+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.379+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.392+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.449+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T14:00:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.511+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.528 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.534+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.547+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.600+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T14:00:48.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.644+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.655 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.661+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.670+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.709 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.715+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T14:00:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.770+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.797+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.805 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.811+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.883+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T14:00:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.946+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.974+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:48.981 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:48.986+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.056+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T14:00:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.130+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.166+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.179+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.227 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.233+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T14:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.320+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.352+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.371+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.434+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T14:00:49.499 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.504+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.582+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.599+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.655+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T14:00:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.728+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.760+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.779+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.853+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T14:00:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.931+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:49.958 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.964+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:49.981+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.037+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T14:00:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.118+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.142+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.157+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.203+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T14:00:50.286 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.292+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.323+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.345+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.387+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T14:00:50.451 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.456+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.488+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.500+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.543+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T14:00:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.625+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.661+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.688+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.744+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T14:00:50.803 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.809+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.835+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.846+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.885+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T14:00:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.924+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.940+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.948+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:50.979+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T14:00:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.023+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.044+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.053+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.096+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T14:00:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.141+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.157+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T14:00:51.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.166+0000 7fdf29f8dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T14:00:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.262+0000 7fdf29f8dec0 20 remove_watcher() i=0 2019-11-27T14:00:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.262+0000 7fdf29f8dec0 2 removed watcher, disabling cache 2019-11-27T14:00:51.303 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.308+0000 7fdf29f8dec0 20 remove_watcher() i=1 2019-11-27T14:00:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.347+0000 7fdf29f8dec0 20 remove_watcher() i=2 2019-11-27T14:00:51.375 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.381+0000 7fdf29f8dec0 20 remove_watcher() i=3 2019-11-27T14:00:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.415+0000 7fdf29f8dec0 20 remove_watcher() i=4 2019-11-27T14:00:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.450+0000 7fdf29f8dec0 20 remove_watcher() i=5 2019-11-27T14:00:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.505+0000 7fdf29f8dec0 20 remove_watcher() i=6 2019-11-27T14:00:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:51.546+0000 7fdf29f8dec0 20 remove_watcher() i=7 2019-11-27T14:00:51.548 INFO:teuthology.run_tasks:Running task s3tests... 2019-11-27T14:00:51.567 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}} 2019-11-27T14:00:51.567 INFO:tasks.s3tests:Downloading s3-tests... 2019-11-27T14:00:51.567 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-11-27T14:00:51.568 INFO:teuthology.orchestra.run.smithi005:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-11-27T14:00:51.647 INFO:teuthology.orchestra.run.smithi005.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-11-27T14:00:52.165 INFO:tasks.s3tests:Creating rgw users... 2019-11-27T14:00:52.165 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-11-27T14:00:52.165 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key STGCFWPFFINYJILWBAOI --secret QIrTUvRFcZbI7R59zeiS/bLNSNQQhvcShOZnbmXOiOcOnRWGaJT5MA== --email bar.client.0+test@test.test --cluster ceph 2019-11-27T14:00:52.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.360+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.391+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.385 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.391+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.394 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.400+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.394 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.400+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.408+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.408+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.426+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.617+0000 7f0073409ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:00:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.617+0000 7f0073409ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:00:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.617+0000 7f0073409ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:00:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.617+0000 7f0073409ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:00:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.617+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.628+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.628+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.637+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.637+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.648+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.648+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.663+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.663+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.670+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.670+0000 7f0073409ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:00:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.670+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.682+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.682+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.696+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.696+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.717+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.717+0000 7f0073409ec0 20 zonegroup default 2019-11-27T14:00:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.717+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.724+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.724+0000 7f0073409ec0 10 Cannot find current period zone using local zone 2019-11-27T14:00:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.724+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.729+0000 7f0073409ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.729+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.738+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.738+0000 7f0073409ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:52.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.746+0000 7f0073409ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:52.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.746+0000 7f0073409ec0 20 zone default found 2019-11-27T14:00:52.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.746+0000 7f0073409ec0 20 started sync module instance, tier type = 2019-11-27T14:00:52.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:52.746+0000 7f0073409ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:00:53.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=0 2019-11-27T14:00:53.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=1 2019-11-27T14:00:53.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=2 2019-11-27T14:00:53.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=3 2019-11-27T14:00:53.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=4 2019-11-27T14:00:53.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=5 2019-11-27T14:00:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.058+0000 7f0073409ec0 20 add_watcher() i=6 2019-11-27T14:00:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.090+0000 7f0073409ec0 20 add_watcher() i=7 2019-11-27T14:00:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.090+0000 7f0073409ec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:00:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.090+0000 7f0030fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:00:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.094+0000 7f005fe35700 0 -- 172.21.15.5:0/3786699378 >> v1:172.21.15.5:6789/0 conn(0x55cb91bb6f60 legacy=0x55cb91bb9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:00:53.126 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:53.132+0000 7f0060636700 0 -- 172.21.15.5:0/76858416 >> [v2:172.21.15.115:6824/9158,v1:172.21.15.115:6825/9158] conn(0x55cb91bc6d50 msgr2=0x55cb91bc9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:00:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.794+0000 7effa2ffd700 20 reqs_thread_entry: start 2019-11-27T14:00:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.795+0000 7effa0ff9700 20 reqs_thread_entry: start 2019-11-27T14:00:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.795+0000 7f0073409ec0 20 init_complete bucket index max shards: 0 2019-11-27T14:00:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.795+0000 7eff96ffd700 20 reqs_thread_entry: start 2019-11-27T14:00:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.795+0000 7f0073409ec0 20 get_system_obj_state: rctx=0x7fff24ce7518 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55cb91c30660 s->prefetch_data=0 2019-11-27T14:00:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.795+0000 7f0073409ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T14:00:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.805+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-27T14:00:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.805+0000 7f0073409ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:00:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.805+0000 7f0073409ec0 20 get_system_obj_state: rctx=0x7fff24ce7528 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55cb91c323f0 s->prefetch_data=0 2019-11-27T14:00:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.805+0000 7f0073409ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-27T14:00:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.837+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-27T14:00:54.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.837+0000 7f0073409ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T14:00:54.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.837+0000 7f0073409ec0 20 get_system_obj_state: rctx=0x7fff24ce7528 obj=default.rgw.meta:users.keys:STGCFWPFFINYJILWBAOI state=0x55cb91c323f0 s->prefetch_data=0 2019-11-27T14:00:54.832 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.837+0000 7f0073409ec0 10 cache get: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI : miss 2019-11-27T14:00:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.846+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI info.flags=0x0 2019-11-27T14:00:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.846+0000 7f0073409ec0 10 adding default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI to cache LRU end 2019-11-27T14:00:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.846+0000 7f0073409ec0 20 get_system_obj_state: rctx=0x7fff24ce7138 obj=default.rgw.meta:users.keys:STGCFWPFFINYJILWBAOI state=0x55cb91c323f0 s->prefetch_data=0 2019-11-27T14:00:54.841 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.846+0000 7f0073409ec0 10 cache get: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI : type miss (requested=0x6, cached=0x0) 2019-11-27T14:00:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.856+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI info.flags=0x0 2019-11-27T14:00:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.856+0000 7f0073409ec0 10 moving default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI to cache LRU end 2019-11-27T14:00:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.856+0000 7f0073409ec0 20 get_system_obj_state: rctx=0x7fff24ce72b8 obj=default.rgw.meta:users.keys:STGCFWPFFINYJILWBAOI state=0x55cb91c323f0 s->prefetch_data=0 2019-11-27T14:00:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.856+0000 7f0073409ec0 10 cache get: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI : type miss (requested=0x6, cached=0x0) 2019-11-27T14:00:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.865+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI info.flags=0x0 2019-11-27T14:00:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.865+0000 7f0073409ec0 10 moving default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI to cache LRU end 2019-11-27T14:00:54.904 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.910+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T14:00:54.905 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.910+0000 7f0073409ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:00:54.905 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.910+0000 7f0073409ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-11-27T14:00:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.924+0000 7f0045ffb700 10 RGWWatcher::handle_notify() notify_id 579820585029 cookie 94332811608704 notifier 4902 bl.length()=617 2019-11-27T14:00:54.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.924+0000 7f0045ffb700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T14:00:54.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:54.924+0000 7f0045ffb700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:00:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.603+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T14:00:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.603+0000 7f0073409ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T14:00:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.603+0000 7f0073409ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-27T14:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.618+0000 7f0045ffb700 10 RGWWatcher::handle_notify() notify_id 579820585030 cookie 94332811608704 notifier 4902 bl.length()=194 2019-11-27T14:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.618+0000 7f0045ffb700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T14:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.618+0000 7f0045ffb700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T14:00:55.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.779+0000 7f0073409ec0 10 cache put: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI info.flags=0x7 2019-11-27T14:00:55.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.779+0000 7f0073409ec0 10 moving default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI to cache LRU end 2019-11-27T14:00:55.774 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.779+0000 7f0073409ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=186 2019-11-27T14:00:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.790+0000 7f0045ffb700 10 RGWWatcher::handle_notify() notify_id 579820584990 cookie 94332811614528 notifier 4902 bl.length()=186 2019-11-27T14:00:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.790+0000 7f0045ffb700 10 cache put: name=default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI info.flags=0x7 2019-11-27T14:00:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:55.790+0000 7f0045ffb700 10 moving default.rgw.meta+users.keys+STGCFWPFFINYJILWBAOI to cache LRU end 2019-11-27T14:00:56.395 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "bar.client.0", 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. bar.client.0", 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "bar.client.0+test@test.test", 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [], 2019-11-27T14:00:56.396 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [ 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "bar.client.0", 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "STGCFWPFFINYJILWBAOI", 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "QIrTUvRFcZbI7R59zeiS/bLNSNQQhvcShOZnbmXOiOcOnRWGaJT5MA==" 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [], 2019-11-27T14:00:56.397 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T14:00:56.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T14:00:56.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T14:00:56.400 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T14:00:56.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:00:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.452+0000 7f0073409ec0 20 remove_watcher() i=0 2019-11-27T14:00:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.452+0000 7f0073409ec0 2 removed watcher, disabling cache 2019-11-27T14:00:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.510+0000 7f0073409ec0 20 remove_watcher() i=1 2019-11-27T14:00:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.586+0000 7f0073409ec0 20 remove_watcher() i=2 2019-11-27T14:00:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.633+0000 7f0073409ec0 20 remove_watcher() i=3 2019-11-27T14:00:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.673+0000 7f0073409ec0 20 remove_watcher() i=4 2019-11-27T14:00:56.710 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.716+0000 7f0073409ec0 20 remove_watcher() i=5 2019-11-27T14:00:56.746 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.752+0000 7f0073409ec0 20 remove_watcher() i=6 2019-11-27T14:00:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.789+0000 7f0073409ec0 20 remove_watcher() i=7 2019-11-27T14:00:56.790 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 1494438697 --totp-seed ONJSGBLIG6M6NAGS7MIEAV5ZD34ROBYGUTZLHUSD22PSD7AUFKKXJANDP4GI7LGT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-27T14:00:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.924+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.958+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.958+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.968+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.968+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.979+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:56.979+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:56.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.001+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.231+0000 7ff335386ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:00:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.231+0000 7ff335386ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:00:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.231+0000 7ff335386ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:00:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.231+0000 7ff335386ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:00:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.231+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.246+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:57.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.246+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.261+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.261+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.275+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:57.269 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.275+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.286+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.286+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.298+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.298+0000 7ff335386ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:00:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.298+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.313+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.313+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.329 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.335+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:57.329 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.335+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.339 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.345+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:00:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.345+0000 7ff335386ec0 20 zonegroup default 2019-11-27T14:00:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.345+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.355+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:57.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.355+0000 7ff335386ec0 10 Cannot find current period zone using local zone 2019-11-27T14:00:57.350 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.355+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.364+0000 7ff335386ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:00:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.364+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.375+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:00:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.375+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:57.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.395+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:00:57.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.395+0000 7ff335386ec0 20 zone default found 2019-11-27T14:00:57.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.395+0000 7ff335386ec0 20 started sync module instance, tier type = 2019-11-27T14:00:57.390 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.395+0000 7ff335386ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:00:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=0 2019-11-27T14:00:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=1 2019-11-27T14:00:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=2 2019-11-27T14:00:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=3 2019-11-27T14:00:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=4 2019-11-27T14:00:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=5 2019-11-27T14:00:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.730+0000 7ff335386ec0 20 add_watcher() i=6 2019-11-27T14:00:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.760+0000 7ff335386ec0 20 add_watcher() i=7 2019-11-27T14:00:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.760+0000 7ff335386ec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:00:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.760+0000 7ff2f2fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:00:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.762+0000 7ff3225b3700 0 -- 172.21.15.5:0/2167598780 >> v2:172.21.15.5:3300/0 conn(0x5568af2ea200 msgr2=0x5568af2ec620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T14:00:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:57.800+0000 7ff322db4700 0 -- 172.21.15.5:0/2710604743 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7ff264017570 msgr2=0x7ff264019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:00:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.258+0000 7ff2617fa700 20 reqs_thread_entry: start 2019-11-27T14:00:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.259+0000 7ff25affd700 20 reqs_thread_entry: start 2019-11-27T14:00:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.259+0000 7ff335386ec0 20 init_complete bucket index max shards: 0 2019-11-27T14:00:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.260+0000 7ff2597fa700 20 reqs_thread_entry: start 2019-11-27T14:00:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.260+0000 7ff335386ec0 20 get_system_obj_state: rctx=0x7ffdae356d98 obj=default.rgw.meta:users.uid:bar.client.0 state=0x5568af368a70 s->prefetch_data=0 2019-11-27T14:00:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.260+0000 7ff335386ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T14:00:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.278+0000 7ff335386ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-27T14:00:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.278+0000 7ff335386ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:00:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.278+0000 7ff335386ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T14:00:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.278+0000 7ff335386ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T14:00:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.278+0000 7ff335386ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T14:00:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.278+0000 7ff335386ec0 20 rados->read ofs=0 len=0 2019-11-27T14:00:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.300+0000 7ff335386ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-27T14:00:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.300+0000 7ff335386ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-27T14:00:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:00:59.300+0000 7ff335386ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:01:01.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:01.755+0000 7ff335386ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T14:01:01.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:01.755+0000 7ff335386ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:01:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:01.755+0000 7ff335386ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-11-27T14:01:01.784 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:01.790+0000 7ff3037fe700 10 RGWWatcher::handle_notify() notify_id 588410519623 cookie 93908103951488 notifier 4619 bl.length()=631 2019-11-27T14:01:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:01.790+0000 7ff3037fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T14:01:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:01.790+0000 7ff3037fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T14:01:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:02.027+0000 7ff335386ec0 20 remove_watcher() i=0 2019-11-27T14:01:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:02.027+0000 7ff335386ec0 2 removed watcher, disabling cache 2019-11-27T14:01:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:02.086+0000 7ff335386ec0 20 remove_watcher() i=1 2019-11-27T14:01:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:02.525+0000 7ff335386ec0 20 remove_watcher() i=2 2019-11-27T14:01:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:02.908+0000 7ff335386ec0 20 remove_watcher() i=3 2019-11-27T14:01:02.958 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:02.964+0000 7ff335386ec0 20 remove_watcher() i=4 2019-11-27T14:01:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.003+0000 7ff335386ec0 20 remove_watcher() i=5 2019-11-27T14:01:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.060+0000 7ff335386ec0 20 remove_watcher() i=6 2019-11-27T14:01:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.120+0000 7ff335386ec0 20 remove_watcher() i=7 2019-11-27T14:01:03.124 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-11-27T14:01:03.124 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key IMQHLTPTLLIKTXVJSSTX --secret nAvOXGpuw+NWMU2uVzTrPByGggYN+XveVx87AAsfYPphr5k4miIzLQ== --email foo.client.0+test@test.test --cluster ceph 2019-11-27T14:01:03.334 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.340+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.367+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.367+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.373+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.373+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.379+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.379+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.386 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.392+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.560+0000 7f0e32cc9ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:01:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.560+0000 7f0e32cc9ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:01:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.560+0000 7f0e32cc9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:01:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.560+0000 7f0e32cc9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:01:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.560+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.570+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.570+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.580+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.580+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.589 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.595+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:03.589 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.595+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.605+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:03.600 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.605+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.611+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.611+0000 7f0e32cc9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:01:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.611+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.616+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.616+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.622+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.622+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.631+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:03.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.631+0000 7f0e32cc9ec0 20 zonegroup default 2019-11-27T14:01:03.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.631+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.636+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.636+0000 7f0e32cc9ec0 10 Cannot find current period zone using local zone 2019-11-27T14:01:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.636+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.641+0000 7f0e32cc9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.641+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.668+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.668+0000 7f0e32cc9ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:03.674 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.679+0000 7f0e32cc9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:03.674 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.679+0000 7f0e32cc9ec0 20 zone default found 2019-11-27T14:01:03.674 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.679+0000 7f0e32cc9ec0 20 started sync module instance, tier type = 2019-11-27T14:01:03.674 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.679+0000 7f0e32cc9ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:01:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=0 2019-11-27T14:01:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=1 2019-11-27T14:01:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=2 2019-11-27T14:01:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=3 2019-11-27T14:01:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=4 2019-11-27T14:01:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=5 2019-11-27T14:01:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:03.997+0000 7f0e32cc9ec0 20 add_watcher() i=6 2019-11-27T14:01:04.023 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:04.029+0000 7f0e32cc9ec0 20 add_watcher() i=7 2019-11-27T14:01:04.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:04.029+0000 7f0e32cc9ec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:01:04.024 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:04.029+0000 7f0d73fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:01:04.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:04.041+0000 7f0e206f7700 0 -- 172.21.15.5:0/1830632408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d160f03320 msgr2=0x55d160f03730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:01:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:04.064+0000 7f0e206f7700 0 -- 172.21.15.5:0/1957337505 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55d160f09230 msgr2=0x55d160f09640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:01:05.834 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.840+0000 7f0d5e7fc700 20 reqs_thread_entry: start 2019-11-27T14:01:05.834 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.840+0000 7f0d57fff700 20 reqs_thread_entry: start 2019-11-27T14:01:05.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.840+0000 7f0e32cc9ec0 20 init_complete bucket index max shards: 0 2019-11-27T14:01:05.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.841+0000 7f0d567fc700 20 reqs_thread_entry: start 2019-11-27T14:01:05.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.841+0000 7f0e32cc9ec0 20 get_system_obj_state: rctx=0x7ffe52c115a8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55d160f82300 s->prefetch_data=0 2019-11-27T14:01:05.836 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.841+0000 7f0e32cc9ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T14:01:05.847 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.853+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-27T14:01:05.847 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.853+0000 7f0e32cc9ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:05.848 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.853+0000 7f0e32cc9ec0 20 get_system_obj_state: rctx=0x7ffe52c115b8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55d160f84090 s->prefetch_data=0 2019-11-27T14:01:05.848 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.853+0000 7f0e32cc9ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-27T14:01:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.862+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-27T14:01:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.862+0000 7f0e32cc9ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T14:01:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.862+0000 7f0e32cc9ec0 20 get_system_obj_state: rctx=0x7ffe52c115b8 obj=default.rgw.meta:users.keys:IMQHLTPTLLIKTXVJSSTX state=0x55d160f84090 s->prefetch_data=0 2019-11-27T14:01:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.862+0000 7f0e32cc9ec0 10 cache get: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX : miss 2019-11-27T14:01:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.871+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX info.flags=0x0 2019-11-27T14:01:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.871+0000 7f0e32cc9ec0 10 adding default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX to cache LRU end 2019-11-27T14:01:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.871+0000 7f0e32cc9ec0 20 get_system_obj_state: rctx=0x7ffe52c111c8 obj=default.rgw.meta:users.keys:IMQHLTPTLLIKTXVJSSTX state=0x55d160f84090 s->prefetch_data=0 2019-11-27T14:01:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.871+0000 7f0e32cc9ec0 10 cache get: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX : type miss (requested=0x6, cached=0x0) 2019-11-27T14:01:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.880+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX info.flags=0x0 2019-11-27T14:01:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.880+0000 7f0e32cc9ec0 10 moving default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX to cache LRU end 2019-11-27T14:01:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.880+0000 7f0e32cc9ec0 20 get_system_obj_state: rctx=0x7ffe52c11348 obj=default.rgw.meta:users.keys:IMQHLTPTLLIKTXVJSSTX state=0x55d160f84090 s->prefetch_data=0 2019-11-27T14:01:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.880+0000 7f0e32cc9ec0 10 cache get: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX : type miss (requested=0x6, cached=0x0) 2019-11-27T14:01:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.889+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX info.flags=0x0 2019-11-27T14:01:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.889+0000 7f0e32cc9ec0 10 moving default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX to cache LRU end 2019-11-27T14:01:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.935+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T14:01:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.935+0000 7f0e32cc9ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.935+0000 7f0e32cc9ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-11-27T14:01:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.952+0000 7f0e156f1700 10 RGWWatcher::handle_notify() notify_id 592705486910 cookie 94357762808416 notifier 4932 bl.length()=617 2019-11-27T14:01:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.953+0000 7f0e156f1700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T14:01:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:05.953+0000 7f0e156f1700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.644+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T14:01:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.645+0000 7f0e32cc9ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T14:01:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.645+0000 7f0e32cc9ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-27T14:01:06.669 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.674+0000 7f0e156f1700 10 RGWWatcher::handle_notify() notify_id 592705486878 cookie 94357762819968 notifier 4932 bl.length()=194 2019-11-27T14:01:06.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.674+0000 7f0e156f1700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T14:01:06.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.674+0000 7f0e156f1700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T14:01:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.849+0000 7f0e32cc9ec0 10 cache put: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX info.flags=0x7 2019-11-27T14:01:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.849+0000 7f0e32cc9ec0 10 moving default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX to cache LRU end 2019-11-27T14:01:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.849+0000 7f0e32cc9ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=186 2019-11-27T14:01:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.871+0000 7f0e156f1700 10 RGWWatcher::handle_notify() notify_id 592705486914 cookie 94357762814304 notifier 4932 bl.length()=186 2019-11-27T14:01:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.871+0000 7f0e156f1700 10 cache put: name=default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX info.flags=0x7 2019-11-27T14:01:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:06.871+0000 7f0e156f1700 10 moving default.rgw.meta+users.keys+IMQHLTPTLLIKTXVJSSTX to cache LRU end 2019-11-27T14:01:07.160 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T14:01:07.160 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "foo.client.0", 2019-11-27T14:01:07.161 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. foo.client.0", 2019-11-27T14:01:07.161 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "foo.client.0+test@test.test", 2019-11-27T14:01:07.161 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T14:01:07.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T14:01:07.161 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [], 2019-11-27T14:01:07.161 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [ 2019-11-27T14:01:07.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T14:01:07.162 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "foo.client.0", 2019-11-27T14:01:07.162 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "IMQHLTPTLLIKTXVJSSTX", 2019-11-27T14:01:07.162 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "nAvOXGpuw+NWMU2uVzTrPByGggYN+XveVx87AAsfYPphr5k4miIzLQ==" 2019-11-27T14:01:07.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T14:01:07.162 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [], 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T14:01:07.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T14:01:07.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T14:01:07.165 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T14:01:07.166 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T14:01:07.166 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.211+0000 7f0e32cc9ec0 20 remove_watcher() i=0 2019-11-27T14:01:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.211+0000 7f0e32cc9ec0 2 removed watcher, disabling cache 2019-11-27T14:01:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.282+0000 7f0e32cc9ec0 20 remove_watcher() i=1 2019-11-27T14:01:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.332+0000 7f0e32cc9ec0 20 remove_watcher() i=2 2019-11-27T14:01:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.400+0000 7f0e32cc9ec0 20 remove_watcher() i=3 2019-11-27T14:01:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.460+0000 7f0e32cc9ec0 20 remove_watcher() i=4 2019-11-27T14:01:07.504 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.508+0000 7f0e32cc9ec0 20 remove_watcher() i=5 2019-11-27T14:01:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.559+0000 7f0e32cc9ec0 20 remove_watcher() i=6 2019-11-27T14:01:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.618+0000 7f0e32cc9ec0 20 remove_watcher() i=7 2019-11-27T14:01:07.621 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8845359435 --totp-seed VIZPHHWJQAVYWNI66MFFM4RSGXEDC57IELNJOTLK2ANVMX2AL5GVLEFKF3COQCJJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-27T14:01:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.778+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:07.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.807+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:07.802 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.807+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.815+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.816+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:07.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.826+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:07.821 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.826+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:07.859+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:08.067 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.072+0000 7ffa80a3aec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:01:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.072+0000 7ffa80a3aec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:01:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.072+0000 7ffa80a3aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:01:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.072+0000 7ffa80a3aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:01:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.072+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.088+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:08.084 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.088+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.106+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:08.101 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.106+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.122+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.122+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.135+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.135+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.146+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.146+0000 7ffa80a3aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:01:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.146+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.156+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.156+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.172+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.172+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.181+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.181+0000 7ffa80a3aec0 20 zonegroup default 2019-11-27T14:01:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.181+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.191+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.191+0000 7ffa80a3aec0 10 Cannot find current period zone using local zone 2019-11-27T14:01:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.191+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.198+0000 7ffa80a3aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:08.194 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.198+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.210+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.210+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.225+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.225+0000 7ffa80a3aec0 20 zone default found 2019-11-27T14:01:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.225+0000 7ffa80a3aec0 20 started sync module instance, tier type = 2019-11-27T14:01:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.225+0000 7ffa80a3aec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:01:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=0 2019-11-27T14:01:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=1 2019-11-27T14:01:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=2 2019-11-27T14:01:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=3 2019-11-27T14:01:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=4 2019-11-27T14:01:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=5 2019-11-27T14:01:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.630+0000 7ffa80a3aec0 20 add_watcher() i=6 2019-11-27T14:01:08.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.675+0000 7ffa80a3aec0 20 add_watcher() i=7 2019-11-27T14:01:08.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.675+0000 7ffa80a3aec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:01:08.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.675+0000 7ffa3e7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:01:08.696 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.701+0000 7ffa6d466700 0 -- 172.21.15.5:0/2930869627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55914658e110 msgr2=0x559146590620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:01:08.747 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:08.752+0000 7ffa6e468700 0 -- 172.21.15.5:0/860102187 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7ff9b001a3d0 msgr2=0x7ff9b001c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T14:01:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.458+0000 7ff9b4ff9700 20 reqs_thread_entry: start 2019-11-27T14:01:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.459+0000 7ff9ae7fc700 20 reqs_thread_entry: start 2019-11-27T14:01:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.459+0000 7ffa80a3aec0 20 init_complete bucket index max shards: 0 2019-11-27T14:01:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.459+0000 7ff9acff9700 20 reqs_thread_entry: start 2019-11-27T14:01:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.459+0000 7ffa80a3aec0 20 get_system_obj_state: rctx=0x7ffdbb03bd68 obj=default.rgw.meta:users.uid:foo.client.0 state=0x5591465ff6b0 s->prefetch_data=0 2019-11-27T14:01:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.459+0000 7ffa80a3aec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T14:01:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.479+0000 7ffa80a3aec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-27T14:01:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.479+0000 7ffa80a3aec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.479+0000 7ffa80a3aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T14:01:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.479+0000 7ffa80a3aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T14:01:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.479+0000 7ffa80a3aec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T14:01:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.479+0000 7ffa80a3aec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.500+0000 7ffa80a3aec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-27T14:01:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.500+0000 7ffa80a3aec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-27T14:01:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.500+0000 7ffa80a3aec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.642+0000 7ffa80a3aec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T14:01:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.642+0000 7ffa80a3aec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.642+0000 7ffa80a3aec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-11-27T14:01:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.655+0000 7ffa4effd700 10 RGWWatcher::handle_notify() notify_id 592705486911 cookie 94082438748032 notifier 4631 bl.length()=631 2019-11-27T14:01:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.655+0000 7ffa4effd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T14:01:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:10.655+0000 7ffa4effd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T14:01:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.196+0000 7ffa80a3aec0 20 remove_watcher() i=0 2019-11-27T14:01:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.196+0000 7ffa80a3aec0 2 removed watcher, disabling cache 2019-11-27T14:01:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.245+0000 7ffa80a3aec0 20 remove_watcher() i=1 2019-11-27T14:01:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.296+0000 7ffa80a3aec0 20 remove_watcher() i=2 2019-11-27T14:01:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.359+0000 7ffa80a3aec0 20 remove_watcher() i=3 2019-11-27T14:01:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.409+0000 7ffa80a3aec0 20 remove_watcher() i=4 2019-11-27T14:01:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.451+0000 7ffa80a3aec0 20 remove_watcher() i=5 2019-11-27T14:01:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.510+0000 7ffa80a3aec0 20 remove_watcher() i=6 2019-11-27T14:01:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.571+0000 7ffa80a3aec0 20 remove_watcher() i=7 2019-11-27T14:01:11.577 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-11-27T14:01:11.577 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key DNORQZRPAJCBEDGWQHSV --secret uy35X91mUKKK2wCtRDK6vMCl6UU1YizXvPboB5hFsUP/HY2XJgWDKg== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-11-27T14:01:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.718+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.754+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.754+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:11.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.765+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:11.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.765+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.775+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.775+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:11.794+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.000+0000 7ff21ddd2ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:01:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.000+0000 7ff21ddd2ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:01:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.000+0000 7ff21ddd2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:01:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.000+0000 7ff21ddd2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:01:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.000+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.014+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.014+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.026+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.026+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.041+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.041+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.059+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.059+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.070+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.070+0000 7ff21ddd2ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:01:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.070+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.079+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.079+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.095+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.095+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.115+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.115+0000 7ff21ddd2ec0 20 zonegroup default 2019-11-27T14:01:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.115+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.127+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:12.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.127+0000 7ff21ddd2ec0 10 Cannot find current period zone using local zone 2019-11-27T14:01:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.127+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.143+0000 7ff21ddd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.143+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.159+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.159+0000 7ff21ddd2ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.170+0000 7ff21ddd2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.170+0000 7ff21ddd2ec0 20 zone default found 2019-11-27T14:01:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.170+0000 7ff21ddd2ec0 20 started sync module instance, tier type = 2019-11-27T14:01:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.170+0000 7ff21ddd2ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:01:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=0 2019-11-27T14:01:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=1 2019-11-27T14:01:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=2 2019-11-27T14:01:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=3 2019-11-27T14:01:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=4 2019-11-27T14:01:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=5 2019-11-27T14:01:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.576+0000 7ff21ddd2ec0 20 add_watcher() i=6 2019-11-27T14:01:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.605+0000 7ff21ddd2ec0 20 add_watcher() i=7 2019-11-27T14:01:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.605+0000 7ff21ddd2ec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:01:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.605+0000 7ff1db7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:01:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.617+0000 7ff20a7fe700 0 -- 172.21.15.5:0/566983957 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55db3201b2b0 msgr2=0x55db3201d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:01:12.645 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:12.650+0000 7ff20b800700 0 -- 172.21.15.5:0/2141447555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55db3201a350 msgr2=0x55db3201a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T14:01:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.048+0000 7ff149ffb700 20 reqs_thread_entry: start 2019-11-27T14:01:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.048+0000 7ff1437fe700 20 reqs_thread_entry: start 2019-11-27T14:01:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.049+0000 7ff21ddd2ec0 20 init_complete bucket index max shards: 0 2019-11-27T14:01:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.049+0000 7ff141ffb700 20 reqs_thread_entry: start 2019-11-27T14:01:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.049+0000 7ff21ddd2ec0 20 get_system_obj_state: rctx=0x7fff5c2cfa58 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55db3208f340 s->prefetch_data=0 2019-11-27T14:01:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.049+0000 7ff21ddd2ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-27T14:01:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.058+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-11-27T14:01:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.058+0000 7ff21ddd2ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.058+0000 7ff21ddd2ec0 20 get_system_obj_state: rctx=0x7fff5c2cfa68 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x55db320910f0 s->prefetch_data=0 2019-11-27T14:01:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.058+0000 7ff21ddd2ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-11-27T14:01:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.065+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-11-27T14:01:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.065+0000 7ff21ddd2ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-27T14:01:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.065+0000 7ff21ddd2ec0 20 get_system_obj_state: rctx=0x7fff5c2cfa68 obj=default.rgw.meta:users.keys:DNORQZRPAJCBEDGWQHSV state=0x55db320910f0 s->prefetch_data=0 2019-11-27T14:01:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.065+0000 7ff21ddd2ec0 10 cache get: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV : miss 2019-11-27T14:01:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.069+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV info.flags=0x0 2019-11-27T14:01:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.069+0000 7ff21ddd2ec0 10 adding default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV to cache LRU end 2019-11-27T14:01:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.069+0000 7ff21ddd2ec0 20 get_system_obj_state: rctx=0x7fff5c2cf678 obj=default.rgw.meta:users.keys:DNORQZRPAJCBEDGWQHSV state=0x55db320910f0 s->prefetch_data=0 2019-11-27T14:01:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.069+0000 7ff21ddd2ec0 10 cache get: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV : type miss (requested=0x6, cached=0x0) 2019-11-27T14:01:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.076+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV info.flags=0x0 2019-11-27T14:01:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.076+0000 7ff21ddd2ec0 10 moving default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV to cache LRU end 2019-11-27T14:01:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.076+0000 7ff21ddd2ec0 20 get_system_obj_state: rctx=0x7fff5c2cf7f8 obj=default.rgw.meta:users.keys:DNORQZRPAJCBEDGWQHSV state=0x55db320910f0 s->prefetch_data=0 2019-11-27T14:01:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.076+0000 7ff21ddd2ec0 10 cache get: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV : type miss (requested=0x6, cached=0x0) 2019-11-27T14:01:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.081+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV info.flags=0x0 2019-11-27T14:01:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.081+0000 7ff21ddd2ec0 10 moving default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV to cache LRU end 2019-11-27T14:01:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.124+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T14:01:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.124+0000 7ff21ddd2ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.124+0000 7ff21ddd2ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-11-27T14:01:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.132+0000 7ff1ebfff700 10 RGWWatcher::handle_notify() notify_id 592705486920 cookie 94399925086208 notifier 4640 bl.length()=691 2019-11-27T14:01:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.132+0000 7ff1ebfff700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T14:01:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.132+0000 7ff1ebfff700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.367+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-27T14:01:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.367+0000 7ff21ddd2ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-27T14:01:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.367+0000 7ff21ddd2ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-11-27T14:01:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.383+0000 7ff1ebfff700 10 RGWWatcher::handle_notify() notify_id 592705486912 cookie 94399925090752 notifier 4640 bl.length()=224 2019-11-27T14:01:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.383+0000 7ff1ebfff700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-27T14:01:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.383+0000 7ff1ebfff700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-27T14:01:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.728+0000 7ff21ddd2ec0 10 cache put: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV info.flags=0x7 2019-11-27T14:01:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.728+0000 7ff21ddd2ec0 10 moving default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV to cache LRU end 2019-11-27T14:01:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.728+0000 7ff21ddd2ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=201 2019-11-27T14:01:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.743+0000 7ff1ebfff700 10 RGWWatcher::handle_notify() notify_id 592705486913 cookie 94399925074208 notifier 4640 bl.length()=201 2019-11-27T14:01:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.743+0000 7ff1ebfff700 10 cache put: name=default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV info.flags=0x7 2019-11-27T14:01:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.743+0000 7ff1ebfff700 10 moving default.rgw.meta+users.keys+DNORQZRPAJCBEDGWQHSV to cache LRU end 2019-11-27T14:01:14.895 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T14:01:14.896 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "testx$tenanteduser.client.0", 2019-11-27T14:01:14.896 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-11-27T14:01:14.896 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-11-27T14:01:14.896 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T14:01:14.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [], 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [ 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "testx$tenanteduser.client.0", 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "DNORQZRPAJCBEDGWQHSV", 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "uy35X91mUKKK2wCtRDK6vMCl6UU1YizXvPboB5hFsUP/HY2XJgWDKg==" 2019-11-27T14:01:14.897 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [], 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T14:01:14.898 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T14:01:14.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T14:01:14.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T14:01:14.901 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T14:01:14.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T14:01:14.901 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T14:01:14.901 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T14:01:14.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.949+0000 7ff21ddd2ec0 20 remove_watcher() i=0 2019-11-27T14:01:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:14.949+0000 7ff21ddd2ec0 2 removed watcher, disabling cache 2019-11-27T14:01:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.008+0000 7ff21ddd2ec0 20 remove_watcher() i=1 2019-11-27T14:01:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.058+0000 7ff21ddd2ec0 20 remove_watcher() i=2 2019-11-27T14:01:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.128+0000 7ff21ddd2ec0 20 remove_watcher() i=3 2019-11-27T14:01:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.189+0000 7ff21ddd2ec0 20 remove_watcher() i=4 2019-11-27T14:01:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.252+0000 7ff21ddd2ec0 20 remove_watcher() i=5 2019-11-27T14:01:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.334+0000 7ff21ddd2ec0 20 remove_watcher() i=6 2019-11-27T14:01:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.387+0000 7ff21ddd2ec0 20 remove_watcher() i=7 2019-11-27T14:01:15.389 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0332834183 --totp-seed QG5E5RV7ML7R6SSWRYVHUV5DXT5EOBSRFVOACVPZWO3ZYBWENZCQ3VGABRKUKVNF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-27T14:01:15.519 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.525+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.550+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.550+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.559+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.553 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.559+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.560 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.565+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.560 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.565+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.586+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.793+0000 7fa69edf0ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T14:01:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.793+0000 7fa69edf0ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T14:01:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.793+0000 7fa69edf0ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T14:01:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.793+0000 7fa69edf0ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T14:01:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.793+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.807+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:15.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.807+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.818+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:15.813 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.819+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.826 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.831+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:15.826 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.831+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.845+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.845+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.854+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.854+0000 7fa69edf0ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T14:01:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.854+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.863+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.863+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.875+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.875+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.885+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T14:01:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.885+0000 7fa69edf0ec0 20 zonegroup default 2019-11-27T14:01:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.885+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.897+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.897+0000 7fa69edf0ec0 10 Cannot find current period zone using local zone 2019-11-27T14:01:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.897+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.906+0000 7fa69edf0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T14:01:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.906+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.925+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T14:01:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.925+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.940+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T14:01:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.940+0000 7fa69edf0ec0 20 zone default found 2019-11-27T14:01:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.940+0000 7fa69edf0ec0 20 started sync module instance, tier type = 2019-11-27T14:01:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:15.940+0000 7fa69edf0ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T14:01:16.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=0 2019-11-27T14:01:16.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=1 2019-11-27T14:01:16.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=2 2019-11-27T14:01:16.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=3 2019-11-27T14:01:16.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=4 2019-11-27T14:01:16.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=5 2019-11-27T14:01:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.346+0000 7fa69edf0ec0 20 add_watcher() i=6 2019-11-27T14:01:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.382+0000 7fa69edf0ec0 20 add_watcher() i=7 2019-11-27T14:01:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.382+0000 7fa69edf0ec0 2 all 8 watchers are set, enabling cache 2019-11-27T14:01:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.382+0000 7fa65cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T14:01:16.379 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.385+0000 7fa68c81e700 0 -- 172.21.15.5:0/4006228974 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55561336bdd0 msgr2=0x55561336c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T14:01:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.412+0000 7fa68b81c700 0 -- 172.21.15.5:0/1329471766 >> v2:172.21.15.115:3300/0 conn(0x555613379410 msgr2=0x55561337b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T14:01:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:16.614+0000 7fa68b81c700 0 --2- 172.21.15.5:0/1329471766 >> v2:172.21.15.115:3300/0 conn(0x555613379410 0x55561337b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T14:01:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.114+0000 7fa5ceffd700 20 reqs_thread_entry: start 2019-11-27T14:01:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.114+0000 7fa5ccff9700 20 reqs_thread_entry: start 2019-11-27T14:01:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.115+0000 7fa69edf0ec0 20 init_complete bucket index max shards: 0 2019-11-27T14:01:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.115+0000 7fa5c2ffd700 20 reqs_thread_entry: start 2019-11-27T14:01:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.115+0000 7fa69edf0ec0 20 get_system_obj_state: rctx=0x7ffc62d83088 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x5556133edb30 s->prefetch_data=0 2019-11-27T14:01:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.115+0000 7fa69edf0ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-27T14:01:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.139+0000 7fa69edf0ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-27T14:01:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.139+0000 7fa69edf0ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.139+0000 7fa69edf0ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T14:01:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.139+0000 7fa69edf0ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T14:01:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.139+0000 7fa69edf0ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T14:01:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.139+0000 7fa69edf0ec0 20 rados->read ofs=0 len=0 2019-11-27T14:01:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.166+0000 7fa69edf0ec0 20 rados_obj.operate() r=0 bl.length=491 2019-11-27T14:01:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.166+0000 7fa69edf0ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-27T14:01:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.166+0000 7fa69edf0ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.354+0000 7fa69edf0ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T14:01:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.354+0000 7fa69edf0ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:18.349 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.354+0000 7fa69edf0ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-11-27T14:01:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.379+0000 7fa681ffb700 10 RGWWatcher::handle_notify() notify_id 592705486921 cookie 93828177848752 notifier 4649 bl.length()=705 2019-11-27T14:01:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.379+0000 7fa681ffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T14:01:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.379+0000 7fa681ffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T14:01:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.983+0000 7fa69edf0ec0 20 remove_watcher() i=0 2019-11-27T14:01:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:18.983+0000 7fa69edf0ec0 2 removed watcher, disabling cache 2019-11-27T14:01:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.051+0000 7fa69edf0ec0 20 remove_watcher() i=1 2019-11-27T14:01:19.143 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.149+0000 7fa69edf0ec0 20 remove_watcher() i=2 2019-11-27T14:01:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.205+0000 7fa69edf0ec0 20 remove_watcher() i=3 2019-11-27T14:01:19.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.262+0000 7fa69edf0ec0 20 remove_watcher() i=4 2019-11-27T14:01:19.308 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.314+0000 7fa69edf0ec0 20 remove_watcher() i=5 2019-11-27T14:01:19.374 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.379+0000 7fa69edf0ec0 20 remove_watcher() i=6 2019-11-27T14:01:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T14:01:19.428+0000 7fa69edf0ec0 20 remove_watcher() i=7 2019-11-27T14:01:19.430 INFO:tasks.s3tests:Configuring s3-tests... 2019-11-27T14:01:19.430 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-11-27T14:01:25.084 INFO:teuthology.orchestra.run.smithi005.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-27T14:01:25.223 INFO:teuthology.orchestra.run.smithi005.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:01:25.265 INFO:teuthology.orchestra.run.smithi005.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:01:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: * base: mirror.jaleco.com 2019-11-27T14:01:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:01:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: * extras: ewr.edge.kernel.org 2019-11-27T14:01:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: * updates: mirror.atlanticmetro.net 2019-11-27T14:01:25.910 INFO:teuthology.orchestra.run.smithi005.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:01:26.261 INFO:teuthology.orchestra.run.smithi005.stdout:Resolving Dependencies 2019-11-27T14:01:26.261 INFO:teuthology.orchestra.run.smithi005.stdout:--> Running transaction check 2019-11-27T14:01:26.262 INFO:teuthology.orchestra.run.smithi005.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-11-27T14:01:26.692 INFO:teuthology.orchestra.run.smithi005.stdout:--> Finished Dependency Resolution 2019-11-27T14:01:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:26.930 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies Resolved 2019-11-27T14:01:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:26.931 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T14:01:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2019-11-27T14:01:26.932 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2019-11-27T14:01:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:26.933 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 23 k 2019-11-27T14:01:26.933 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 27 k 2019-11-27T14:01:26.933 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading packages: 2019-11-27T14:01:27.069 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2019-11-27T14:01:27.075 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2019-11-27T14:01:27.077 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded 2019-11-27T14:01:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2019-11-27T14:01:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-27T14:01:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-27T14:01:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:28.074 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2019-11-27T14:01:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-11-27T14:01:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:28.074 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2019-11-27T14:01:28.244 INFO:teuthology.orchestra.run.smithi005.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-11-27T14:01:29.618 INFO:teuthology.orchestra.run.smithi005.stdout:Installing setuptools, pip, wheel...done. 2019-11-27T14:01:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:Cache entry deserialization failed, entry ignored 2019-11-27T14:01:30.148 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting pip 2019-11-27T14:01:30.274 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-27T14:01:30.368 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: pip 2019-11-27T14:01:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: pip 9.0.1 2019-11-27T14:01:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: Uninstalling pip-9.0.1: 2019-11-27T14:01:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: Successfully uninstalled pip-9.0.1 2019-11-27T14:01:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed pip-19.3.1 2019-11-27T14:01:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T14:01:32.298 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting setuptools==32.3.1 2019-11-27T14:01:32.301 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-27T14:01:32.342 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: setuptools 2019-11-27T14:01:32.342 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: setuptools 28.8.0 2019-11-27T14:01:32.358 INFO:teuthology.orchestra.run.smithi005.stdout: Uninstalling setuptools-28.8.0: 2019-11-27T14:01:32.367 INFO:teuthology.orchestra.run.smithi005.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-27T14:01:32.496 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed setuptools-32.3.1 2019-11-27T14:01:32.974 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T14:01:33.202 INFO:teuthology.orchestra.run.smithi005.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-27T14:01:33.259 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting nose>=1.0.0 2019-11-27T14:01:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-27T14:01:33.366 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting boto>=2.6.0 2019-11-27T14:01:33.372 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-27T14:01:33.932 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting boto3>=1.0.0 2019-11-27T14:01:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/67/17/567f679dac6ec93611ce05637094e9736afa40e41c9ed0aaefd90de6f7e8/boto3-1.10.28-py2.py3-none-any.whl (128kB) 2019-11-27T14:01:34.121 INFO:teuthology.orchestra.run.smithi005.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-27T14:01:34.385 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting gevent>=1.0 2019-11-27T14:01:34.400 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T14:01:34.676 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting isodate>=0.4.4 2019-11-27T14:01:34.688 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-11-27T14:01:34.879 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting requests>=0.14.0 2019-11-27T14:01:34.888 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-11-27T14:01:35.165 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting pytz>=2011k 2019-11-27T14:01:35.174 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-11-27T14:01:35.382 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting ordereddict 2019-11-27T14:01:35.391 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-11-27T14:01:35.730 INFO:teuthology.orchestra.run.smithi005.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-11-27T14:01:36.121 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting lxml 2019-11-27T14:01:36.137 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T14:01:36.911 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting botocore<1.14.0,>=1.13.28 2019-11-27T14:01:36.922 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/8e/b3/ab9044d3aa14208f5b6f69665d5f82ad9b028809666e4e70dac1ab0bfd3a/botocore-1.13.28-py2.py3-none-any.whl (5.7MB) 2019-11-27T14:01:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-11-27T14:01:37.507 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-11-27T14:01:37.619 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-11-27T14:01:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-11-27T14:01:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-27T14:01:37.842 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T14:01:38.038 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting six 2019-11-27T14:01:38.049 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-27T14:01:38.140 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-11-27T14:01:38.154 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-11-27T14:01:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting idna<2.9,>=2.5 2019-11-27T14:01:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-11-27T14:01:38.423 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-11-27T14:01:38.434 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-11-27T14:01:38.576 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting certifi>=2017.4.17 2019-11-27T14:01:38.587 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/18/b0/8146a4f8dd402f60744fa380bc73ca47303cccf8b9190fd16a827281eac2/certifi-2019.9.11-py2.py3-none-any.whl (154kB) 2019-11-27T14:01:38.681 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting docutils<0.16,>=0.10 2019-11-27T14:01:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-11-27T14:01:38.866 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-11-27T14:01:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-11-27T14:01:38.991 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-11-27T14:01:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-11-27T14:01:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:Building wheels for collected packages: ordereddict 2019-11-27T14:01:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for ordereddict (setup.py): started 2019-11-27T14:01:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-11-27T14:01:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=6d8740efc714f7e958646a841e04814ce6176e430d10553d0a56983e9f348df3 2019-11-27T14:01:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-11-27T14:01:39.303 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully built ordereddict 2019-11-27T14:01:39.403 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-11-27T14:01:41.727 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 boto3-1.10.28 botocore-1.13.28 bunch-1.0.1 certifi-2019.9.11 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-11-27T14:01:42.051 INFO:teuthology.orchestra.run.smithi005.stdout:running develop 2019-11-27T14:01:42.108 INFO:teuthology.orchestra.run.smithi005.stdout:running egg_info 2019-11-27T14:01:42.108 INFO:teuthology.orchestra.run.smithi005.stdout:creating s3tests.egg-info 2019-11-27T14:01:42.108 INFO:teuthology.orchestra.run.smithi005.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-11-27T14:01:42.108 INFO:teuthology.orchestra.run.smithi005.stdout:writing s3tests.egg-info/PKG-INFO 2019-11-27T14:01:42.108 INFO:teuthology.orchestra.run.smithi005.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-11-27T14:01:42.109 INFO:teuthology.orchestra.run.smithi005.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-11-27T14:01:42.110 INFO:teuthology.orchestra.run.smithi005.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-11-27T14:01:42.110 INFO:teuthology.orchestra.run.smithi005.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-27T14:01:42.112 INFO:teuthology.orchestra.run.smithi005.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-27T14:01:42.113 INFO:teuthology.orchestra.run.smithi005.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-27T14:01:42.114 INFO:teuthology.orchestra.run.smithi005.stdout:running build_ext 2019-11-27T14:01:42.115 INFO:teuthology.orchestra.run.smithi005.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-11-27T14:01:42.115 INFO:teuthology.orchestra.run.smithi005.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-11-27T14:01:42.118 INFO:teuthology.orchestra.run.smithi005.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T14:01:42.118 INFO:teuthology.orchestra.run.smithi005.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T14:01:42.118 INFO:teuthology.orchestra.run.smithi005.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T14:01:42.118 INFO:teuthology.orchestra.run.smithi005.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T14:01:42.118 INFO:teuthology.orchestra.run.smithi005.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T14:01:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.119 INFO:teuthology.orchestra.run.smithi005.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-11-27T14:01:42.119 INFO:teuthology.orchestra.run.smithi005.stdout:Processing dependencies for s3tests==0.0.1 2019-11-27T14:01:42.178 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for isodate==0.6.0 2019-11-27T14:01:42.178 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: isodate 0.6.0 2019-11-27T14:01:42.178 INFO:teuthology.orchestra.run.smithi005.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-27T14:01:42.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.179 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.179 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for gevent==1.4.0 2019-11-27T14:01:42.179 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: gevent 1.4.0 2019-11-27T14:01:42.180 INFO:teuthology.orchestra.run.smithi005.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-27T14:01:42.180 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.180 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.181 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for bunch==1.0.1 2019-11-27T14:01:42.181 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: bunch 1.0.1 2019-11-27T14:01:42.181 INFO:teuthology.orchestra.run.smithi005.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-27T14:01:42.182 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.182 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.182 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for PyYAML==5.1.2 2019-11-27T14:01:42.182 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: PyYAML 5.1.2 2019-11-27T14:01:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-27T14:01:42.183 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for boto3==1.10.28 2019-11-27T14:01:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: boto3 1.10.28 2019-11-27T14:01:42.184 INFO:teuthology.orchestra.run.smithi005.stdout:Adding boto3 1.10.28 to easy-install.pth file 2019-11-27T14:01:42.184 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.184 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.184 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for boto==2.49.0 2019-11-27T14:01:42.185 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: boto 2.49.0 2019-11-27T14:01:42.185 INFO:teuthology.orchestra.run.smithi005.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-27T14:01:42.186 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.186 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.186 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for six==1.13.0 2019-11-27T14:01:42.186 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: six 1.13.0 2019-11-27T14:01:42.186 INFO:teuthology.orchestra.run.smithi005.stdout:Adding six 1.13.0 to easy-install.pth file 2019-11-27T14:01:42.187 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.187 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.187 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for greenlet==0.4.15 2019-11-27T14:01:42.187 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: greenlet 0.4.15 2019-11-27T14:01:42.188 INFO:teuthology.orchestra.run.smithi005.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-27T14:01:42.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.188 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.188 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for s3transfer==0.2.1 2019-11-27T14:01:42.189 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: s3transfer 0.2.1 2019-11-27T14:01:42.189 INFO:teuthology.orchestra.run.smithi005.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-11-27T14:01:42.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.189 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.189 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for jmespath==0.9.4 2019-11-27T14:01:42.189 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: jmespath 0.9.4 2019-11-27T14:01:42.190 INFO:teuthology.orchestra.run.smithi005.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-11-27T14:01:42.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for botocore==1.13.28 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: botocore 1.13.28 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Adding botocore 1.13.28 to easy-install.pth file 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for futures==3.3.0 2019-11-27T14:01:42.191 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: futures 3.3.0 2019-11-27T14:01:42.193 INFO:teuthology.orchestra.run.smithi005.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for urllib3==1.25.7 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: urllib3 1.25.7 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.194 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.195 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for python-dateutil==2.8.0 2019-11-27T14:01:42.195 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: python-dateutil 2.8.0 2019-11-27T14:01:42.195 INFO:teuthology.orchestra.run.smithi005.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-11-27T14:01:42.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.195 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.196 INFO:teuthology.orchestra.run.smithi005.stdout:Searching for docutils==0.15.2 2019-11-27T14:01:42.196 INFO:teuthology.orchestra.run.smithi005.stdout:Best match: docutils 0.15.2 2019-11-27T14:01:42.196 INFO:teuthology.orchestra.run.smithi005.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-11-27T14:01:42.196 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T14:01:42.196 INFO:teuthology.orchestra.run.smithi005.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T14:01:42.197 INFO:teuthology.orchestra.run.smithi005.stdout:Finished processing dependencies for s3tests==0.0.1 2019-11-27T14:01:42.203 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-11-27T14:01:42.279 INFO:tasks.s3tests:Configuring boto... 2019-11-27T14:01:42.279 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-27T14:01:42.388 INFO:teuthology.orchestra.run.smithi005:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-11-27T14:01:47.182 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-11-27T14:01:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-11-27T14:01:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-11-27T14:01:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-11-27T14:02:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-11-27T14:02:01.580 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-11-27T14:02:03.816 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:07:37.886 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:03.845 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:07:37.915 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:03.894 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:07:37.965 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:03.899 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:07:37.909 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:03.900 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:07:37.970 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:03.902 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:07:37.912 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:03.984 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:07:38.054 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:04.025 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:07:38.096 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:04.061 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:07:38.071 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:05.874 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-11-27T14:02:07.692 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-11-27T14:02:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-11-27T14:02:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-11-27T14:02:12.903 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-11-27T14:02:16.065 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-11-27T14:02:17.899 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-11-27T14:02:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-11-27T14:02:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-11-27T14:02:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-11-27T14:02:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-11-27T14:02:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-11-27T14:02:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-11-27T14:02:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-27T14:02:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-11-27T14:02:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-11-27T14:02:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-11-27T14:02:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-27T14:02:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-11-27T14:02:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-27T14:02:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-11-27T14:02:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-11-27T14:02:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-11-27T14:02:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-27T14:02:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-11-27T14:02:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-11-27T14:02:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-27T14:02:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-11-27T14:02:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-11-27T14:02:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-11-27T14:02:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-27T14:02:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-11-27T14:02:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-27T14:02:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-27T14:02:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-27T14:02:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-11-27T14:02:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-11-27T14:02:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-11-27T14:02:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-11-27T14:02:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-11-27T14:02:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-11-27T14:02:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-11-27T14:02:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-11-27T14:02:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-11-27T14:02:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-11-27T14:02:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-11-27T14:02:36.883 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:08:10.953 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.893 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:08:10.962 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.916 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:08:10.986 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.917 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:08:10.927 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.921 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:08:10.991 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.923 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:08:10.933 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.943 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:08:11.012 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.968 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:08:11.038 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:36.994 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:08:11.004 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-11-27T14:02:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-11-27T14:02:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-11-27T14:02:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-11-27T14:03:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-11-27T14:03:03.950 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-11-27T14:03:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-11-27T14:03:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-11-27T14:03:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-11-27T14:03:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-11-27T14:03:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-11-27T14:03:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-11-27T14:03:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-11-27T14:03:13.631 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-11-27T14:03:13.631 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-11-27T14:03:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-11-27T14:03:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-27T14:03:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-27T14:03:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-11-27T14:03:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-11-27T14:03:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-27T14:03:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-27T14:03:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-11-27T14:03:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-11-27T14:03:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-11-27T14:03:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-11-27T14:03:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-11-27T14:03:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-11-27T14:03:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:SKIP 2019-11-27T14:03:13.664 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-11-27T14:05:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-27T14:05:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-27T14:05:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-27T14:05:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-27T14:05:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-27T14:05:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-27T14:05:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-27T14:05:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-27T14:05:08.785 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-27T14:05:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-27T14:05:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-27T14:05:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-27T14:05:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-27T14:05:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-27T14:05:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-27T14:05:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-27T14:05:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-27T14:05:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-27T14:05:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-27T14:05:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-27T14:05:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-27T14:05:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-27T14:05:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-27T14:05:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-27T14:05:09.280 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-27T14:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-27T14:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-27T14:05:09.453 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-27T14:05:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... ok 2019-11-27T14:05:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... ok 2019-11-27T14:05:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... ok 2019-11-27T14:05:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... ok 2019-11-27T14:05:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... ok 2019-11-27T14:05:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... ok 2019-11-27T14:05:51.249 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... ok 2019-11-27T14:05:53.586 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... ok 2019-11-27T14:05:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... ok 2019-11-27T14:06:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... ok 2019-11-27T14:06:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... ok 2019-11-27T14:06:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... ok 2019-11-27T14:06:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... ok 2019-11-27T14:06:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... ok 2019-11-27T14:06:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... ok 2019-11-27T14:06:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... ok 2019-11-27T14:06:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... ok 2019-11-27T14:06:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... ok 2019-11-27T14:06:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... ok 2019-11-27T14:06:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... ok 2019-11-27T14:06:31.014 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... ok 2019-11-27T14:06:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... ok 2019-11-27T14:06:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... ok 2019-11-27T14:06:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... ok 2019-11-27T14:06:39.168 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... ok 2019-11-27T14:06:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... ok 2019-11-27T14:06:39.330 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... ok 2019-11-27T14:06:39.622 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... ok 2019-11-27T14:06:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... ok 2019-11-27T14:06:39.765 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... ok 2019-11-27T14:06:42.971 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... ok 2019-11-27T14:06:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... ok 2019-11-27T14:06:54.913 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... ok 2019-11-27T14:07:00.046 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... ok 2019-11-27T14:07:06.790 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... ok 2019-11-27T14:07:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... ok 2019-11-27T14:07:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... ok 2019-11-27T14:07:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... ok 2019-11-27T14:07:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... ok 2019-11-27T14:07:47.935 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:13:22.003 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:47.945 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:13:22.012 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:47.954 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:13:22.021 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:47.958 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:13:22.025 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:47.961 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:13:21.972 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:47.966 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:13:21.977 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:48.146 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:13:22.214 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:48.157 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:13:22.167 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:48.177 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:13:22.244 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:07:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... ok 2019-11-27T14:07:51.719 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... ok 2019-11-27T14:07:57.740 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... ok 2019-11-27T14:08:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... ok 2019-11-27T14:08:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... ok 2019-11-27T14:08:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... ok 2019-11-27T14:08:44.946 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... ok 2019-11-27T14:08:53.134 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... ok 2019-11-27T14:09:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... ok 2019-11-27T14:09:08.668 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... ok 2019-11-27T14:09:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... ok 2019-11-27T14:09:20.583 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... ok 2019-11-27T14:09:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... ok 2019-11-27T14:09:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... ok 2019-11-27T14:09:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... ok 2019-11-27T14:09:52.354 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... ok 2019-11-27T14:10:01.159 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... ok 2019-11-27T14:10:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... ok 2019-11-27T14:10:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... ok 2019-11-27T14:10:20.533 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... ok 2019-11-27T14:10:25.415 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:15:59.481 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.421 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:15:59.488 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.446 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:15:59.512 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.451 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:15:59.518 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.472 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:15:59.482 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.481 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:15:59.491 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.504 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:15:59.570 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.559 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:15:59.625 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:25.568 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:15:59.578 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:10:27.278 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... ok 2019-11-27T14:10:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... ok 2019-11-27T14:10:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... ok 2019-11-27T14:12:59.352 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:18:33.418 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.358 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:18:33.425 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.366 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:18:33.432 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.370 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:18:33.381 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.373 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:18:33.440 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.390 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:18:33.400 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.463 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:18:33.530 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.483 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:18:33.549 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:12:59.557 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:18:33.567 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.698 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:23:45.765 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.705 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:23:45.771 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.716 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:23:45.782 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.718 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:23:45.785 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.726 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:23:45.737 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.732 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:23:45.743 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.914 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:23:45.980 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:11.933 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:23:46.000 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:12.028 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:23:46.039 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.809 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:24:20.875 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.839 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:24:20.850 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.842 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:24:20.908 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.857 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:24:20.867 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.865 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:24:20.931 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.871 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:24:20.938 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.877 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:24:20.943 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.892 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:24:20.902 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:18:46.910 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:24:20.976 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.742 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:28:55.808 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.746 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:28:55.812 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.756 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:28:55.822 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.759 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:28:55.770 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.761 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:28:55.827 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.770 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:28:55.781 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.974 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:28:56.040 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.975 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:28:55.986 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:23:21.989 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:28:56.055 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.407 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:32:42.473 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.418 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:32:42.484 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.441 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:32:42.507 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.465 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:32:42.531 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.481 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:32:42.492 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.484 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:32:42.495 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.558 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:32:42.625 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.616 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:32:42.683 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:27:08.645 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:32:42.656 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... ok 2019-11-27T14:28:33.800 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:34:07.867 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.812 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:34:07.879 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.831 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:34:07.897 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.834 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:34:07.901 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.835 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:34:07.846 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.854 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:34:07.865 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.907 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:34:07.973 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.922 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:34:07.988 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:33.992 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:34:08.003 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:28:36.791 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... ok 2019-11-27T14:28:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... ok 2019-11-27T14:28:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... ok 2019-11-27T14:28:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... ok 2019-11-27T14:29:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... ok 2019-11-27T14:29:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... ok 2019-11-27T14:29:13.813 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... ok 2019-11-27T14:29:21.927 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... ok 2019-11-27T14:29:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... ok 2019-11-27T14:29:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... ok 2019-11-27T14:29:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... ok 2019-11-27T14:29:47.429 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... ok 2019-11-27T14:29:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... ok 2019-11-27T14:30:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... ok 2019-11-27T14:30:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... ok 2019-11-27T14:30:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... ok 2019-11-27T14:30:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... ok 2019-11-27T14:30:36.713 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... ok 2019-11-27T14:30:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... ok 2019-11-27T14:30:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... ok 2019-11-27T14:30:57.858 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-27T14:31:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-27T14:31:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... ok 2019-11-27T14:31:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... ok 2019-11-27T14:31:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... ok 2019-11-27T14:31:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... ok 2019-11-27T14:31:52.864 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... ok 2019-11-27T14:32:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... ok 2019-11-27T14:32:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... ok 2019-11-27T14:33:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... ok 2019-11-27T14:33:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... ok 2019-11-27T14:33:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... ok 2019-11-27T14:33:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... ok 2019-11-27T14:33:44.710 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:39:18.778 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.718 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:39:18.786 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.735 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:39:18.803 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.741 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:39:18.751 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.742 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:39:18.810 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.747 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:39:18.758 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.954 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:39:19.022 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.954 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:39:19.022 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:44.974 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:39:18.986 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:33:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... ok 2019-11-27T14:33:53.813 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... ok 2019-11-27T14:34:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... ok 2019-11-27T14:34:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... ok 2019-11-27T14:34:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... ok 2019-11-27T14:34:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... ok 2019-11-27T14:34:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... ok 2019-11-27T14:34:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... ok 2019-11-27T14:35:10.225 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:40:44.293 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.229 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:40:44.298 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.286 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:40:44.354 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.294 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:40:44.304 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.303 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:40:44.314 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.306 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:40:44.375 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.347 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:40:44.415 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.376 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:40:44.444 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:10.381 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:40:44.392 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... ok 2019-11-27T14:35:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... ok 2019-11-27T14:35:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... ok 2019-11-27T14:35:27.962 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... ok 2019-11-27T14:35:30.262 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:41:04.331 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.311 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:41:04.380 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.320 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:41:04.389 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.334 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:41:04.403 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.348 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:41:04.359 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.351 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:41:04.420 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.361 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:41:04.372 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.368 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:41:04.436 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.391 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:41:04.402 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:35:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... ok 2019-11-27T14:35:31.314 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... ok 2019-11-27T14:35:31.787 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... ok 2019-11-27T14:35:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... ok 2019-11-27T14:35:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... ok 2019-11-27T14:35:47.407 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... ok 2019-11-27T14:35:47.896 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... ok 2019-11-27T14:35:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... ok 2019-11-27T14:35:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... ok 2019-11-27T14:35:59.912 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... ok 2019-11-27T14:36:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... ok 2019-11-27T14:36:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... ok 2019-11-27T14:36:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... ok 2019-11-27T14:36:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... ok 2019-11-27T14:36:36.698 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... ok 2019-11-27T14:36:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... ok 2019-11-27T14:36:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... ok 2019-11-27T14:36:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... ok 2019-11-27T14:36:54.705 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... ok 2019-11-27T14:37:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... ok 2019-11-27T14:37:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... ok 2019-11-27T14:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... ok 2019-11-27T14:37:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... ok 2019-11-27T14:37:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... ok 2019-11-27T14:37:20.747 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... ok 2019-11-27T14:37:24.382 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... ok 2019-11-27T14:37:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... ok 2019-11-27T14:37:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... ok 2019-11-27T14:37:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... ok 2019-11-27T14:37:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... ok 2019-11-27T14:37:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... ok 2019-11-27T14:37:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... ok 2019-11-27T14:37:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... ok 2019-11-27T14:37:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... ok 2019-11-27T14:38:00.031 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... ok 2019-11-27T14:38:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... ok 2019-11-27T14:38:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... ok 2019-11-27T14:38:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... ok 2019-11-27T14:38:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... ok 2019-11-27T14:38:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... ok 2019-11-27T14:38:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... ok 2019-11-27T14:38:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... ok 2019-11-27T14:38:27.961 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... ok 2019-11-27T14:38:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... ok 2019-11-27T14:38:34.763 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... ok 2019-11-27T14:38:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... ok 2019-11-27T14:38:41.024 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... ok 2019-11-27T14:38:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... ok 2019-11-27T14:38:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... ok 2019-11-27T14:38:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... ok 2019-11-27T14:38:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... ok 2019-11-27T14:38:54.713 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... ok 2019-11-27T14:38:55.939 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:44:30.008 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:55.951 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:44:30.020 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:55.955 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:44:30.024 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:55.959 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:44:30.028 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:55.965 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:44:29.976 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:56.010 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:44:30.021 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:56.132 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:44:30.200 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:56.145 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:44:30.214 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:56.151 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:44:30.162 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:38:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... ok 2019-11-27T14:38:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... ok 2019-11-27T14:39:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... ok 2019-11-27T14:39:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... ok 2019-11-27T14:39:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... ok 2019-11-27T14:39:16.416 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... ok 2019-11-27T14:39:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... ok 2019-11-27T14:39:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... ok 2019-11-27T14:39:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... ok 2019-11-27T14:39:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... ok 2019-11-27T14:39:43.231 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... ok 2019-11-27T14:39:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... ok 2019-11-27T14:39:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... ok 2019-11-27T14:40:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... ok 2019-11-27T14:40:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... ok 2019-11-27T14:40:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... ok 2019-11-27T14:40:21.225 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... ok 2019-11-27T14:40:25.949 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... ok 2019-11-27T14:40:29.704 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... ok 2019-11-27T14:40:41.284 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... ok 2019-11-27T14:40:53.134 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... ok 2019-11-27T14:41:00.092 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... ok 2019-11-27T14:41:03.798 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... ok 2019-11-27T14:41:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... ok 2019-11-27T14:41:21.217 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... ok 2019-11-27T14:41:26.642 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... ok 2019-11-27T14:41:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... ok 2019-11-27T14:41:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... ok 2019-11-27T14:41:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... ok 2019-11-27T14:41:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... ok 2019-11-27T14:41:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... ok 2019-11-27T14:42:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... ok 2019-11-27T14:42:06.691 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... ok 2019-11-27T14:42:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... ok 2019-11-27T14:42:16.590 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... ok 2019-11-27T14:42:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... ok 2019-11-27T14:42:23.464 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... ok 2019-11-27T14:42:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... ok 2019-11-27T14:42:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... ok 2019-11-27T14:42:38.451 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... ok 2019-11-27T14:42:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... ok 2019-11-27T14:42:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... ok 2019-11-27T14:42:40.481 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... ok 2019-11-27T14:42:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... ok 2019-11-27T14:42:46.171 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... ok 2019-11-27T14:42:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... ok 2019-11-27T14:42:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... ok 2019-11-27T14:42:55.182 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... ok 2019-11-27T14:42:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... ok 2019-11-27T14:43:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... ok 2019-11-27T14:43:04.979 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... ok 2019-11-27T14:43:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... ok 2019-11-27T14:43:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... ok 2019-11-27T14:43:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... ok 2019-11-27T14:43:23.536 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... ok 2019-11-27T14:43:29.363 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... ok 2019-11-27T14:43:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... ok 2019-11-27T14:43:39.341 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... ok 2019-11-27T14:43:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... ok 2019-11-27T14:43:51.421 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... ok 2019-11-27T14:43:51.713 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:49:25.781 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:51.751 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:49:25.819 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:51.772 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:49:25.840 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:51.795 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:49:25.806 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:51.797 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:49:25.865 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:51.801 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:49:25.813 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:51.916 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:49:25.984 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:52.009 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:49:26.076 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:52.021 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:49:26.032 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:43:57.351 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... ok 2019-11-27T14:44:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... ok 2019-11-27T14:44:06.854 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:49:40.922 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.867 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:49:40.935 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.882 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:49:40.950 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.886 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:49:40.897 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.890 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:49:40.958 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.893 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:49:40.904 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.907 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:49:40.975 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.931 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:49:40.999 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:06.977 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:49:40.989 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:44:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... ok 2019-11-27T14:44:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... ok 2019-11-27T14:44:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... ok 2019-11-27T14:44:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... ok 2019-11-27T14:44:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... ok 2019-11-27T14:44:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... ok 2019-11-27T14:44:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... ok 2019-11-27T14:44:47.472 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... ok 2019-11-27T14:44:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... ok 2019-11-27T14:45:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... ok 2019-11-27T14:45:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... ok 2019-11-27T14:45:13.190 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... ok 2019-11-27T14:45:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... ok 2019-11-27T14:45:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... ok 2019-11-27T14:45:30.346 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... ok 2019-11-27T14:45:32.699 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... ok 2019-11-27T14:45:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... ok 2019-11-27T14:45:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... ok 2019-11-27T14:45:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... ok 2019-11-27T14:46:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... ok 2019-11-27T14:46:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... ok 2019-11-27T14:46:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... ok 2019-11-27T14:46:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... ok 2019-11-27T14:46:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... ok 2019-11-27T14:46:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... ok 2019-11-27T14:47:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... ok 2019-11-27T14:47:16.299 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... ok 2019-11-27T14:47:27.530 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... ok 2019-11-27T14:47:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... ok 2019-11-27T14:47:52.978 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... ok 2019-11-27T14:47:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... ok 2019-11-27T14:47:54.319 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... ok 2019-11-27T14:47:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... ok 2019-11-27T14:48:04.017 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok 2019-11-27T14:48:16.938 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok 2019-11-27T14:48:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok 2019-11-27T14:48:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok 2019-11-27T14:48:31.126 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... ok 2019-11-27T14:49:07.901 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... ok 2019-11-27T14:49:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... ok 2019-11-27T14:49:18.772 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:54:52.840 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:18.779 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:54:52.848 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:18.786 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:54:52.855 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:18.791 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:54:52.803 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:18.793 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:54:52.861 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:18.798 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:54:52.810 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:18.973 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:54:53.041 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:19.005 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:54:53.073 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:19.179 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:54:53.190 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... ok 2019-11-27T14:49:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... ok 2019-11-27T14:49:42.427 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... ok 2019-11-27T14:49:47.576 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... ok 2019-11-27T14:49:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok 2019-11-27T14:50:03.503 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... ok 2019-11-27T14:50:09.280 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... ok 2019-11-27T14:50:16.957 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... ok 2019-11-27T14:50:25.011 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... ok 2019-11-27T14:50:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... ok 2019-11-27T14:50:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... ok 2019-11-27T14:50:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... ok 2019-11-27T14:50:57.427 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... ok 2019-11-27T14:51:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... ok 2019-11-27T14:51:53.431 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok 2019-11-27T14:52:13.108 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:57:47.175 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.145 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:57:47.213 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.152 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:57:47.220 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.155 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:57:47.223 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.187 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:57:47.198 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.193 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:57:47.204 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.249 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:01:57:47.317 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.255 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:01:57:47.323 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:13.304 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:01:57:47.315 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:52:41.782 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:52:41.739+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-27T14:53:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ok 2019-11-27T14:53:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... ok 2019-11-27T14:53:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... ok 2019-11-27T14:53:50.580 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:53:50.552+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:53:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... ok 2019-11-27T14:53:57.712 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... ok 2019-11-27T14:54:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... ok 2019-11-27T14:54:30.785 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:00:04.853 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.792 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:00:04.860 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.803 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:00:04.870 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.806 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:00:04.873 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.811 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:00:04.823 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.824 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:00:04.836 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.907 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:00:04.975 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.908 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:00:04.975 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:30.952 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:00:04.964 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:54:52.239 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:54:52.093+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:55:05.836 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:55:05.790+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-27T14:55:24.541 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:55:24.527+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-27T14:55:26.914 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... ok 2019-11-27T14:55:58.864 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:55:58.843+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:56:31.533 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:56:31.467+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:57:17.463 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... ok 2019-11-27T14:57:45.001 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:57:44.956+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:57:47.396 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:57:47.347+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:58:03.267 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:58:03.253+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-27T14:58:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... ok 2019-11-27T14:58:06.865 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:58:06.814+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:58:41.689 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:58:41.498+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:59:15.142 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T14:59:15.038+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T14:59:42.913 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:05:16.981 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:42.920 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:05:16.988 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:42.929 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:05:16.997 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:42.934 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:05:17.002 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:42.939 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:05:16.950 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:42.945 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:05:16.957 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:43.113 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:05:17.181 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:43.128 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:05:17.140 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:43.180 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:05:17.246 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.855 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:06:08.923 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.882 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:06:08.949 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.911 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:06:08.922 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.913 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:06:08.981 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.916 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:06:08.928 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.929 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:06:08.997 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.936 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:06:09.004 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.955 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:06:08.966 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:34.979 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:06:09.046 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:02:47.334 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T15:02:47.332+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-27T15:03:19.715 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T15:03:19.658+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-27T15:04:55.050 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:10:29.118 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.059 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:10:29.127 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.066 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:10:29.134 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.069 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:10:29.137 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.080 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:10:29.092 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.092 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:10:29.103 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.224 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:10:29.292 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.291 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:10:29.359 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:04:55.311 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:10:29.323 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:05:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... ok 2019-11-27T15:06:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... ok 2019-11-27T15:08:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... ok 2019-11-27T15:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... ok 2019-11-27T15:08:56.340 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:14:30.408 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.361 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:14:30.429 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.422 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:14:30.490 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.429 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:14:30.441 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.431 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:14:30.495 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.440 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:14:30.452 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.481 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:14:30.549 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:08:56.562 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:14:30.573 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.161 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:14:30.640 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... ok 2019-11-27T15:09:25.151 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok 2019-11-27T15:09:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... ok 2019-11-27T15:09:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... ok 2019-11-27T15:10:06.622 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:15:40.689 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.628 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:15:40.696 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.638 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:15:40.650 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.640 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:15:40.708 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.643 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:15:40.655 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.644 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:15:40.712 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.705 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:15:40.773 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.707 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:15:40.718 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:06.726 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:15:40.794 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:10:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... ok 2019-11-27T15:10:18.405 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... ok 2019-11-27T15:10:26.666 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... ok 2019-11-27T15:10:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... ok 2019-11-27T15:10:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... ok 2019-11-27T15:11:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... ok 2019-11-27T15:11:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... ok 2019-11-27T15:11:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... ok 2019-11-27T15:11:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... ok 2019-11-27T15:11:40.157 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... ok 2019-11-27T15:11:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... ok 2019-11-27T15:12:08.551 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... ok 2019-11-27T15:12:20.987 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... ok 2019-11-27T15:12:39.131 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... ok 2019-11-27T15:12:51.992 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... ok 2019-11-27T15:13:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... ok 2019-11-27T15:13:33.620 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... ok 2019-11-27T15:13:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... ok 2019-11-27T15:13:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... ok 2019-11-27T15:14:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... ok 2019-11-27T15:14:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... ok 2019-11-27T15:14:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... ok 2019-11-27T15:14:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... ok 2019-11-27T15:14:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... ok 2019-11-27T15:14:42.717 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... ok 2019-11-27T15:14:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... ok 2019-11-27T15:14:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... ok 2019-11-27T15:15:17.934 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:20:52.001 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.878 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:20:51.968 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.879 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:20:51.996 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.879 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:20:52.222 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.879 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:20:52.007 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.879 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:20:52.196 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.879 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:20:52.014 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.879 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:20:52.019 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:15:27.880 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:20:52.217 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.005 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:22:12.072 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.013 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:22:12.080 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.052 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:22:12.064 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.054 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:22:12.066 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.078 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:22:12.145 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.084 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:22:12.152 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.110 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:22:12.177 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.139 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:22:12.130 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:38.152 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:22:12.219 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.148 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:22:52.215 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.176 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:22:52.243 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.177 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:22:52.245 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.192 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:22:52.260 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.198 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:22:52.209 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.205 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:22:52.217 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.215 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:22:52.282 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.231 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:22:52.298 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:18.259 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:22:52.271 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... ok 2019-11-27T15:20:29.883 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:26:03.950 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:29.893 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:26:03.960 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:29.901 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:26:03.913 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:29.902 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:26:03.969 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:29.908 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:26:03.975 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:29.912 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:26:03.924 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:30.038 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:26:04.105 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:30.039 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:26:04.107 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:20:30.094 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:26:04.106 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:14.308 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok 2019-11-27T15:21:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... ok 2019-11-27T15:21:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... ok 2019-11-27T15:22:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... ok 2019-11-27T15:24:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... ok 2019-11-27T15:25:43.751 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:31:17.817 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:43.757 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:31:17.823 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:43.770 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:31:17.836 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:43.773 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:31:17.839 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:43.773 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:31:17.785 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:43.781 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:31:17.793 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:43.989 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:31:18.055 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:44.048 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:31:18.114 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:44.073 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:31:18.085 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.267 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:31:19.279 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.269 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:31:19.280 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.284 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:31:19.295 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.414 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:31:19.480 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.416 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:31:19.482 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.434 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:31:19.501 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:31:19.798 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.733 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:31:19.799 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:31:19.811 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:26:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok 2019-11-27T15:30:55.873 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:36:29.938 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:55.899 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:36:29.948 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:55.899 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:36:29.956 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:55.899 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:36:29.959 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:55.903 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:36:29.915 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:55.919 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:36:29.931 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:56.101 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:36:30.167 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:36:30.183 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:30:56.203 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:36:30.215 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.391 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:39:40.457 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.415 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:39:40.481 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.427 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:39:40.439 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.431 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:39:40.497 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.432 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:39:40.498 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.446 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:39:40.458 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:39:40.585 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.528 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:39:40.589 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:06.547 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:39:40.559 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:34:47.596 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... ok 2019-11-27T15:36:06.884 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:41:40.950 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:06.897 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:41:40.963 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:06.911 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:41:40.977 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:06.913 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:41:40.924 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:06.917 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:41:40.983 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:06.926 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:41:40.938 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:07.019 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:41:41.085 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:07.072 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:41:41.138 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:07.082 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:41:41.094 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:36:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok 2019-11-27T15:37:09.447 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... ok 2019-11-27T15:37:51.684 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... ok 2019-11-27T15:38:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... ok 2019-11-27T15:38:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok 2019-11-27T15:38:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok 2019-11-27T15:39:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... ok 2019-11-27T15:39:42.551 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... ok 2019-11-27T15:39:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... Exception in thread Thread-55: 2019-11-27T15:39:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:39:52.169 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:39:52.169 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:39:52.170 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:39:52.171 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:39:52.171 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:39:52.171 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:39:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-52: 2019-11-27T15:39:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:39:52.178 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:39:52.178 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:39:52.178 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:39:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:39:52.180 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:39:52.195 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-51: 2019-11-27T15:39:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:39:52.196 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:39:52.196 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:39:52.196 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:39:52.196 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:39:52.197 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:39:52.321 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-54: 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:39:52.322 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:39:52.323 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:39:52.323 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:39:52.323 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:39:52.323 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:39:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:39:52.323 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-63: 2019-11-27T15:40:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:09.849 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:09.849 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:09.849 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:09.849 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:09.850 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:09.850 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:09.850 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:09.850 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:09.850 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:09.851 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:09.851 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-64: 2019-11-27T15:40:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:09.927 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:09.927 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:09.927 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:09.927 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:09.928 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:09.928 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:09.928 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:09.928 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:09.929 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:09.929 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:09.929 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-65: 2019-11-27T15:40:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:10.117 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:10.117 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:10.117 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:10.117 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:10.118 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:10.118 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:10.118 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:10.118 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:10.118 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:10.119 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:10.119 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:10.119 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-62: 2019-11-27T15:40:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:10.155 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:10.156 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:10.156 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:10.156 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:10.156 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:10.156 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:10.157 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:10.157 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:10.157 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:10.157 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:10.158 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:26.179 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-75: 2019-11-27T15:40:26.179 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:26.180 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:26.181 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:26.181 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:26.181 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:26.181 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-71: 2019-11-27T15:40:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:26.200 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:26.201 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:26.201 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:26.201 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:26.201 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-74: 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:26.611 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:26.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-73: 2019-11-27T15:40:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:26.702 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:26.703 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:26.704 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:26.704 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:26.704 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-84: 2019-11-27T15:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:42.854 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:42.859 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-81: 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:42.860 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:42.861 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:42.861 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:42.861 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:42.861 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:42.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-85: 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:43.050 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:40:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-82: 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:40:43.052 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:40:43.053 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:40:43.053 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:40:43.053 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:40:43.053 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:40:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:40:43.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:00.428 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-94: 2019-11-27T15:41:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:06.396 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:06.397 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:06.398 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:06.398 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:06.398 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-93: 2019-11-27T15:41:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:06.399 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:06.399 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:06.399 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:06.400 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-92: 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:06.401 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-95: 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:06.403 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:06.404 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:ok 2019-11-27T15:41:17.865 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:46:51.932 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:17.875 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:46:51.941 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:17.885 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:46:51.897 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:17.889 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:46:51.955 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:17.892 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:46:51.904 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:17.897 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:46:51.963 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:18.089 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:46:52.156 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:18.136 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:46:52.148 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:18.146 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:46:52.213 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:41:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... Exception in thread Thread-101: 2019-11-27T15:41:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:23.672 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:23.673 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:23.674 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:23.674 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:23.674 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-103: 2019-11-27T15:41:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:24.005 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:24.005 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:24.005 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:24.005 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:24.006 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-105: 2019-11-27T15:41:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:24.561 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:24.562 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:24.563 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:24.563 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-106: 2019-11-27T15:41:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:24.868 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:24.869 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:24.870 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:24.870 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:24.870 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-104: 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:24.871 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:24.872 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:24.924 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-107: 2019-11-27T15:41:24.924 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:24.925 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:24.926 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:24.926 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:24.926 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:24.926 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:24.926 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-109: 2019-11-27T15:41:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:24.996 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:24.996 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:24.996 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:24.996 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:24.998 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:Exception in thread Thread-108: 2019-11-27T15:41:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:Traceback (most recent call last): 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: self.run() 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T15:41:25.019 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T15:41:25.020 INFO:teuthology.orchestra.run.smithi005.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T15:41:25.020 INFO:teuthology.orchestra.run.smithi005.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T15:41:25.020 INFO:teuthology.orchestra.run.smithi005.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T15:41:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T15:41:25.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T15:41:45.821 INFO:teuthology.orchestra.run.smithi005.stderr:ok 2019-11-27T15:41:50.964 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... ok 2019-11-27T15:41:56.529 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... ok 2019-11-27T15:42:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... ok 2019-11-27T15:42:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... ok 2019-11-27T15:42:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... ok 2019-11-27T15:42:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... ok 2019-11-27T15:42:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... ok 2019-11-27T15:42:18.048 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... ok 2019-11-27T15:42:25.426 INFO:teuthology.orchestra.run.smithi005.stderr:Check for valid x-amz-expiration header after PUT ... ok 2019-11-27T15:42:28.020 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:48:02.086 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.024 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:48:02.091 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.077 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:48:02.144 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.078 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:48:02.145 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.096 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:48:02.107 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.099 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:48:02.111 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.120 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:48:02.187 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.129 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:48:02.196 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:28.215 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:48:02.226 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:30.898 INFO:teuthology.orchestra.run.smithi005.stderr:Check for valid x-amz-expiration header on HEAD request ... ok 2019-11-27T15:42:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:Check for valid x-amz-expiration header on GET request ... ok 2019-11-27T15:42:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:Check x-amz-expiration-header object tags interaction ... ok 2019-11-27T15:42:56.816 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... ok 2019-11-27T15:43:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... ok 2019-11-27T15:43:10.773 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... ok 2019-11-27T15:43:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... ok 2019-11-27T15:43:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... ok 2019-11-27T15:43:26.506 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... ok 2019-11-27T15:43:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... ok 2019-11-27T15:43:36.617 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... ok 2019-11-27T15:43:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... ok 2019-11-27T15:43:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... ok 2019-11-27T15:43:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... ok 2019-11-27T15:43:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... ok 2019-11-27T15:43:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... ok 2019-11-27T15:44:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... ok 2019-11-27T15:44:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... ok 2019-11-27T15:44:08.343 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... ok 2019-11-27T15:45:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... ok 2019-11-27T15:46:24.615 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... ok 2019-11-27T15:46:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... ok 2019-11-27T15:46:28.796 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:52:02.863 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:28.807 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:52:02.874 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:28.818 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:52:02.830 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:28.822 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:52:02.889 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:28.823 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:52:02.835 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:28.827 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:52:02.894 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:28.964 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:52:03.031 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:29.010 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:52:03.076 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:29.016 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:52:03.027 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:46:32.947 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... ok 2019-11-27T15:46:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... ok 2019-11-27T15:46:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... ok 2019-11-27T15:46:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... ok 2019-11-27T15:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... ok 2019-11-27T15:48:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... ok 2019-11-27T15:49:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... ok 2019-11-27T15:49:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... ok 2019-11-27T15:49:12.909 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... ok 2019-11-27T15:49:17.875 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... ok 2019-11-27T15:49:22.438 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... ok 2019-11-27T15:49:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... ok 2019-11-27T15:49:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... ok 2019-11-27T15:49:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... ok 2019-11-27T15:49:47.346 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... ok 2019-11-27T15:49:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... ok 2019-11-27T15:50:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... ok 2019-11-27T15:50:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... ok 2019-11-27T15:50:30.520 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... ok 2019-11-27T15:50:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... ok 2019-11-27T15:50:47.364 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... ok 2019-11-27T15:50:49.501 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:56:23.568 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.521 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:56:23.588 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.594 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:56:23.661 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.603 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:56:23.615 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.606 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:56:23.673 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.606 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:56:23.618 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.694 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:56:23.761 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.737 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:56:23.804 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:49.761 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:56:23.773 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... ok 2019-11-27T15:51:01.577 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... ok 2019-11-27T15:51:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... ok 2019-11-27T15:51:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... ok 2019-11-27T15:51:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... ok 2019-11-27T15:51:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... ok 2019-11-27T15:51:40.742 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:57:14.810 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.745 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:57:14.813 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.761 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:57:14.773 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.767 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:57:14.779 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.791 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:57:14.858 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.795 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:57:14.862 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.808 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:02:57:14.876 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.860 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:02:57:14.927 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:40.876 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:02:57:14.888 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... ok 2019-11-27T15:51:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... ok 2019-11-27T15:51:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... ok 2019-11-27T15:51:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... ok 2019-11-27T15:52:08.636 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... ok 2019-11-27T15:52:16.330 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... ok 2019-11-27T15:52:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... ok 2019-11-27T15:52:43.240 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... ok 2019-11-27T15:54:16.500 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... ok 2019-11-27T15:54:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... ok 2019-11-27T15:54:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... ok 2019-11-27T15:54:58.596 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... ok 2019-11-27T15:55:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... ok 2019-11-27T15:55:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... ok 2019-11-27T15:55:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... ok 2019-11-27T15:55:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... ok 2019-11-27T15:56:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... ok 2019-11-27T15:56:07.696 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... ok 2019-11-27T15:56:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... ok 2019-11-27T15:56:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... ok 2019-11-27T15:56:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... ok 2019-11-27T15:56:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... ok 2019-11-27T15:56:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... ok 2019-11-27T15:56:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... ok 2019-11-27T15:56:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... ok 2019-11-27T15:56:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... ok 2019-11-27T15:56:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... ok 2019-11-27T15:56:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... ok 2019-11-27T15:56:59.899 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:02:28.821 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.899 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:02:28.826 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.899 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:02:29.048 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... ok 2019-11-27T15:56:59.900 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:02:28.854 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.900 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:02:28.858 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.900 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:02:29.096 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.900 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:02:28.867 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.900 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:02:28.870 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:56:59.901 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:02:29.087 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... ok 2019-11-27T15:57:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... ok 2019-11-27T15:57:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... ok 2019-11-27T15:57:30.906 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:03:04.974 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:30.940 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:03:05.008 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:30.947 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:03:04.959 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:30.967 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:03:05.035 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:30.969 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:03:05.036 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:30.981 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:03:04.993 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:30.996 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:03:05.064 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:31.025 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:03:05.093 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:31.026 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:03:05.037 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:57:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... ok 2019-11-27T15:57:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... ok 2019-11-27T15:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... ok 2019-11-27T15:58:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... ok 2019-11-27T15:58:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... ok 2019-11-27T15:58:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... ok 2019-11-27T15:58:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... ok 2019-11-27T15:58:48.707 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... ok 2019-11-27T15:58:58.527 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... ok 2019-11-27T15:59:02.787 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... ok 2019-11-27T15:59:11.999 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... ok 2019-11-27T15:59:16.320 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:04:50.388 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.324 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:04:50.391 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.382 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:04:50.450 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.385 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:04:50.453 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.390 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:04:50.401 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.395 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:04:50.407 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.447 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:04:50.515 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.462 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:04:50.529 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:16.496 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:04:50.508 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... ok 2019-11-27T15:59:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... ok 2019-11-27T15:59:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... ok 2019-11-27T15:59:59.779 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-11-27T16:02:06.870 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:07:40.937 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:06.878 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:07:40.945 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:06.882 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:07:40.894 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:06.887 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:07:40.954 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:06.887 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:07:40.899 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:06.892 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:07:40.960 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:07.008 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:07:41.075 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:07.010 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:07:41.077 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:02:07.019 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:07:41.030 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.083 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:12:53.150 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.089 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:12:53.156 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.095 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:12:53.162 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.097 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:12:53.109 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.100 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:12:53.167 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.105 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:12:53.117 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.302 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:12:53.313 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.384 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:12:53.451 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:19.393 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:12:53.460 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:37.893 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:13:11.960 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.304 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:13:11.963 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.304 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:13:11.975 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.304 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:13:12.010 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.305 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:13:11.973 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.305 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:13:12.005 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.305 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:13:11.995 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.305 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:13:11.997 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:47.305 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:13:12.030 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.390 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:18:05.457 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.406 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:18:05.473 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.407 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:18:05.474 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.410 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:18:05.477 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.420 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:18:05.430 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.426 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:18:05.437 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.600 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:18:05.667 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.600 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:18:05.667 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:12:31.641 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:18:05.646 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:21:38.626 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.571 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:21:38.638 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.595 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:21:38.662 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.625 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:21:38.692 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.639 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:21:38.650 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.647 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:21:38.658 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:21:38.782 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.774 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:21:38.840 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:16:04.826 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:21:38.837 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.533 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:23:17.600 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.575 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:23:17.641 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.575 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:23:17.586 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.578 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:23:17.589 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.604 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:23:17.670 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.616 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:23:17.682 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.648 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:23:17.714 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.706 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:23:17.718 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:17:43.710 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:23:17.777 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.796 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:28:29.862 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.812 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:28:29.879 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.815 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:28:29.826 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.819 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:28:29.885 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.823 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:28:29.889 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.826 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:28:29.837 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.994 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:28:30.060 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:55.996 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:28:30.008 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:22:56.043 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:28:30.109 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:26.067 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:30:00.133 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.057 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:30:00.106 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.057 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:30:00.172 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.057 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:30:00.248 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.057 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:30:00.192 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.057 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:30:00.270 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.058 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:30:00.204 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.058 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:30:00.214 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:41.058 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:30:00.287 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:47.864 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:38:21.929 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:47.869 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:38:21.935 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:47.906 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:38:21.917 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:47.923 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:38:21.989 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:47.945 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:38:21.956 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:47.958 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:38:22.024 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:48.187 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:38:22.253 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:48.201 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:38:22.267 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:48.209 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:38:22.220 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.092 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:38:52.159 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.101 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:38:52.167 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.108 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:38:52.174 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.112 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:38:52.123 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.114 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:38:52.180 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.134 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:38:52.145 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.148 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:38:52.214 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.154 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:38:52.220 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:33:18.182 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:38:52.193 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.196 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:44:04.262 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.204 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:44:04.270 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.216 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:44:04.282 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.223 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:44:04.289 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.224 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:44:04.236 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.237 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:44:04.249 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.415 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:44:04.482 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.426 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:44:04.438 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:38:30.435 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:44:04.501 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.627 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:46:43.693 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.633 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:46:43.700 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.680 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:46:43.746 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.701 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:46:43.756 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.719 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:46:43.730 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.721 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:46:43.733 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.728 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:46:43.794 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.778 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:46:43.844 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:09.900 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:46:43.912 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.153 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:49:15.219 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.162 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:49:15.228 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.175 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:49:15.241 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.179 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:49:15.190 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.182 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:49:15.249 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.185 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:49:15.196 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.297 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:49:15.364 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.305 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:49:15.372 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:43:41.313 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:49:15.325 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.630 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:54:28.697 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.646 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:54:28.713 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.649 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:54:28.716 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.655 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:54:28.722 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.662 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:54:28.673 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.682 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:54:28.694 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.865 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:54:28.932 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.867 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:54:28.934 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:48:54.929 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:54:28.941 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.257 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:55:05.324 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.278 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:55:05.344 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.297 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:55:05.364 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.300 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:55:05.366 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.309 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:55:05.321 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.316 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:55:05.328 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.332 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:55:05.399 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.350 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:55:05.417 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:31.360 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:55:05.371 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:06.815 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:59:40.880 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:06.823 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:59:40.889 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:06.833 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:59:40.899 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:06.836 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:59:40.848 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:06.837 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:59:40.903 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:06.843 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:59:40.854 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:07.013 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:03:59:41.079 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:07.016 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:03:59:41.082 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:54:07.039 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:03:59:41.050 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.163 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:03:27.229 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.181 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:03:27.247 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.223 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:03:27.288 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.224 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:03:27.290 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.231 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:03:27.243 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.235 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:03:27.246 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.301 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:03:27.366 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.332 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:03:27.398 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:53.378 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:03:27.389 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:16.939 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:04:51.004 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:16.951 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:04:51.016 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:16.956 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:04:51.022 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:16.961 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:04:51.026 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:16.964 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:04:50.975 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:16.978 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:04:50.989 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:17.027 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:04:51.093 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:17.034 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:04:51.099 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:17.065 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:04:51.076 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.214 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:10:01.279 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.221 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:10:01.286 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.226 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:10:01.291 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.230 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:10:01.296 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.231 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:10:01.242 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.236 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:10:01.247 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.459 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:10:01.470 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.516 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:10:01.581 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:04:27.519 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:10:01.584 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.759 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:11:48.824 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.766 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:11:48.831 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.810 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:11:48.875 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.823 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:11:48.888 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.841 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:11:48.852 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.844 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:11:48.855 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.867 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:11:48.932 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.885 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:11:48.950 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:14.924 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:11:48.935 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.367 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:15:13.432 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.384 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:15:13.449 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.385 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:15:13.450 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.388 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:15:13.453 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.393 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:15:13.404 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.409 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:15:13.421 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.526 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:15:13.591 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.531 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:15:13.597 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:09:39.570 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:15:13.581 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.290 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:20:10.354 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.335 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:20:10.400 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.351 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:20:10.416 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.362 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:20:10.373 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.369 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:20:10.380 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.376 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:20:10.441 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.486 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:20:10.551 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.523 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:20:10.534 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:36.524 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:20:10.589 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.499 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:20:23.563 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.506 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:20:23.571 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.518 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:20:23.582 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.523 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:20:23.588 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.531 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:20:23.542 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.540 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:20:23.551 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.550 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:20:23.615 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.556 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:20:23.621 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:49.591 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:20:23.602 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.541 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:25:11.606 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.576 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:25:11.641 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.603 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:25:11.668 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.651 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:25:11.661 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.651 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:25:11.715 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.659 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:25:11.671 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.807 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:25:11.872 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.883 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:25:11.947 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:19:37.943 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:25:11.953 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.663 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:25:35.728 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.668 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:25:35.733 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.687 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:25:35.752 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.692 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:25:35.757 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.697 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:25:35.708 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.705 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:25:35.770 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.713 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:25:35.724 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.744 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:25:35.809 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:20:01.880 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:25:35.891 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.212 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:28:32.276 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.250 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:28:32.314 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.265 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:28:32.330 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.270 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:28:32.334 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.290 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:28:32.300 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.296 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:28:32.307 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.354 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:28:32.418 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.391 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:28:32.456 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:58.442 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:28:32.453 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.745 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:30:48.810 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.749 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:30:48.813 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.781 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:30:48.792 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.808 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:30:48.819 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.822 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:30:48.887 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.831 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:30:48.896 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.848 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:30:48.911 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:14.977 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:30:49.041 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:25:15.021 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:30:49.032 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.039 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:36:01.103 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.049 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:36:01.113 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.051 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:36:01.116 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.057 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:36:01.121 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.072 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:36:01.083 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.081 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:36:01.092 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.250 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:36:01.314 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.302 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:36:01.366 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:30:27.315 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:36:01.326 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.718 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:36:53.782 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.759 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:36:53.823 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.770 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:36:53.834 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.772 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:36:53.837 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.789 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:36:53.800 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.797 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:36:53.808 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.800 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:36:53.865 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.831 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:36:53.893 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:19.843 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:36:53.854 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.707 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:41:11.771 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.712 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:41:11.776 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.720 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:41:11.784 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.725 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:41:11.789 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.736 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:41:11.747 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.742 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:41:11.753 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.893 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:41:11.957 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.940 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:41:12.004 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:35:37.971 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:41:11.982 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.287 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:45:15.351 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.305 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:45:15.369 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.338 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:45:15.349 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.343 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:45:15.354 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.344 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:45:15.408 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.360 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:45:15.424 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.498 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:45:15.562 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.517 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:45:15.528 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:41.540 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:45:15.603 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.611 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:46:21.674 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.620 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:46:21.684 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.628 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:46:21.692 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.634 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:46:21.698 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.638 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:46:21.649 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.643 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:46:21.654 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.687 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:46:21.751 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.704 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:46:21.768 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:40:47.722 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:46:21.733 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.622 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:51:34.686 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.636 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:51:34.647 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.637 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:51:34.701 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.641 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:51:34.652 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.642 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:51:34.705 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.648 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:51:34.712 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.835 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:51:34.898 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.850 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:51:34.861 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:46:00.882 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:51:34.946 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:02.866 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:53:36.930 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:02.905 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:53:36.969 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:02.915 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:53:36.979 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:02.926 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:53:36.937 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:02.933 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:53:36.997 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:02.933 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:53:36.940 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:03.000 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:53:37.063 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:03.000 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:53:37.064 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:48:03.033 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:53:37.044 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:49:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-27T17:49:59.902 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-27T17:49:59.902 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-27T17:49:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-27T17:49:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-27T17:49:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-27T17:49:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-27T17:50:00.268 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-27T17:50:00.431 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-27T17:50:00.770 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-27T17:50:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-27T17:50:00.816 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-27T17:50:00.816 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-27T17:50:00.816 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-27T17:50:00.816 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-27T17:50:00.817 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-27T17:50:00.822 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-27T17:50:00.822 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-27T17:50:00.822 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-27T17:50:00.822 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-27T17:50:00.827 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-27T17:50:00.827 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-27T17:50:00.827 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-27T17:50:00.828 INFO:teuthology.orchestra.run.smithi005.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-27T17:50:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-27T17:50:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-27T17:50:00.871 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-27T17:50:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-27T17:50:01.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T17:50:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:---------------------------------------------------------------------- 2019-11-27T17:50:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:Ran 611 tests in 13698.318s 2019-11-27T17:50:01.011 INFO:teuthology.orchestra.run.smithi005.stderr: 2019-11-27T17:50:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:OK (SKIP=75) 2019-11-27T17:50:01.057 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-11-27T17:50:01.057 INFO:teuthology.orchestra.run.smithi005:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-11-27T17:50:01.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T17:50:01.188 INFO:tasks.s3tests:Cleaning up boto... 2019-11-27T17:50:01.188 INFO:teuthology.orchestra.run.smithi005:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-27T17:50:01.246 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-11-27T17:50:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.373+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.400+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.400+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.406+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.406+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.412+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.412+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.428+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.693+0000 7f20d581cec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T17:50:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.693+0000 7f20d581cec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T17:50:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.693+0000 7f20d581cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:50:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.693+0000 7f20d581cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:50:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.693+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.705+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.705+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.716 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.715+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:01.716 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.715+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.731+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.731+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.743+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:01.745 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.743+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.748+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.748+0000 7f20d581cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:50:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.748+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.758+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.758+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.774+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.774+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.794+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.794+0000 7f20d581cec0 20 zonegroup default 2019-11-27T17:50:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.794+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.804+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.804+0000 7f20d581cec0 10 Cannot find current period zone using local zone 2019-11-27T17:50:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.804+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.817+0000 7f20d581cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.817+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.833+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.833+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.848+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.848+0000 7f20d581cec0 20 zone default found 2019-11-27T17:50:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.848+0000 7f20d581cec0 20 started sync module instance, tier type = 2019-11-27T17:50:01.850 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:01.848+0000 7f20d581cec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T17:50:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=0 2019-11-27T17:50:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=1 2019-11-27T17:50:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=2 2019-11-27T17:50:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=3 2019-11-27T17:50:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=4 2019-11-27T17:50:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=5 2019-11-27T17:50:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.253+0000 7f20d581cec0 20 add_watcher() i=6 2019-11-27T17:50:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.285+0000 7f20d581cec0 20 add_watcher() i=7 2019-11-27T17:50:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.285+0000 7f20d581cec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:50:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.286+0000 7f20937de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:50:02.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.292+0000 7f20c2a49700 0 -- 172.21.15.5:0/4146231259 >> v2:172.21.15.5:3300/0 conn(0x55953b8d7f40 msgr2=0x55953b8da360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T17:50:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.544+0000 7f20c2a49700 0 --2- 172.21.15.5:0/4146231259 >> v2:172.21.15.5:3300/0 conn(0x55953b8d7f40 0x55953b8da360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T17:50:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:02.603+0000 7f20c2a49700 0 -- 172.21.15.5:0/134380955 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7f2004017580 msgr2=0x7f2004019a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:50:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.399+0000 7f2001ffb700 20 reqs_thread_entry: start 2019-11-27T17:50:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.399+0000 7f1ffb7fe700 20 reqs_thread_entry: start 2019-11-27T17:50:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.399+0000 7f20d581cec0 20 init_complete bucket index max shards: 0 2019-11-27T17:50:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.400+0000 7f1ff9ffb700 20 reqs_thread_entry: start 2019-11-27T17:50:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.400+0000 7f20d581cec0 20 get_system_obj_state: rctx=0x7ffca94ee978 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55953b9567d0 s->prefetch_data=0 2019-11-27T17:50:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.400+0000 7f20d581cec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T17:50:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.422+0000 7f20d581cec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-27T17:50:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.422+0000 7f20d581cec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.422+0000 7f20d581cec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T17:50:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.422+0000 7f20d581cec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T17:50:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.422+0000 7f20d581cec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T17:50:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.422+0000 7f20d581cec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.436+0000 7f20d581cec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-27T17:50:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.436+0000 7f20d581cec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-27T17:50:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.436+0000 7f20d581cec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.581+0000 7f20d581cec0 10 removing key index: STGCFWPFFINYJILWBAOI 2019-11-27T17:50:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.581+0000 7f20d581cec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-11-27T17:50:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.592+0000 7f20a3fff700 10 RGWWatcher::handle_notify() notify_id 592705486972 cookie 94099437540320 notifier 4664 bl.length()=170 2019-11-27T17:50:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.849+0000 7f20d581cec0 10 removing email index: bar.client.0+test@test.test 2019-11-27T17:50:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.850+0000 7f20d581cec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-11-27T17:50:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:04.890+0000 7f20a3fff700 10 RGWWatcher::handle_notify() notify_id 592705487295 cookie 94099437533920 notifier 4664 bl.length()=178 2019-11-27T17:50:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:05.350+0000 7f20d581cec0 10 removing user buckets index 2019-11-27T17:50:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:05.350+0000 7f20d581cec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-11-27T17:50:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:05.361+0000 7f20a3fff700 10 RGWWatcher::handle_notify() notify_id 592705487019 cookie 94099437538784 notifier 4664 bl.length()=169 2019-11-27T17:50:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.070+0000 7f20d581cec0 10 removing user index: bar.client.0 2019-11-27T17:50:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.070+0000 7f20d581cec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-11-27T17:50:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.070+0000 7f20d581cec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-11-27T17:50:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.085+0000 7f20a3fff700 10 RGWWatcher::handle_notify() notify_id 592705487296 cookie 94099437533920 notifier 4664 bl.length()=161 2019-11-27T17:50:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.512+0000 7f20d581cec0 20 remove_watcher() i=0 2019-11-27T17:50:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.512+0000 7f20d581cec0 2 removed watcher, disabling cache 2019-11-27T17:50:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.558+0000 7f20d581cec0 20 remove_watcher() i=1 2019-11-27T17:50:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.595+0000 7f20d581cec0 20 remove_watcher() i=2 2019-11-27T17:50:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.637+0000 7f20d581cec0 20 remove_watcher() i=3 2019-11-27T17:50:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.670+0000 7f20d581cec0 20 remove_watcher() i=4 2019-11-27T17:50:06.702 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.700+0000 7f20d581cec0 20 remove_watcher() i=5 2019-11-27T17:50:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.731+0000 7f20d581cec0 20 remove_watcher() i=6 2019-11-27T17:50:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.758+0000 7f20d581cec0 20 remove_watcher() i=7 2019-11-27T17:50:06.767 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-11-27T17:50:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.874+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.904+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.904+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.914+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.914+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.923+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:06.923+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.154+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.366+0000 7f3c119b9ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T17:50:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.366+0000 7f3c119b9ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T17:50:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.366+0000 7f3c119b9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:50:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.366+0000 7f3c119b9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:50:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.366+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.379 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.378+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:07.379 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.378+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.393+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.393+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.409+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:07.411 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.409+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.429+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.429+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.438+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.438+0000 7f3c119b9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:50:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.438+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.449 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.448+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:07.449 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.448+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.463+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.463+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.477+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.477+0000 7f3c119b9ec0 20 zonegroup default 2019-11-27T17:50:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.477+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.486+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:07.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.486+0000 7f3c119b9ec0 10 Cannot find current period zone using local zone 2019-11-27T17:50:07.488 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.486+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.498 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.497+0000 7f3c119b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:07.498 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.497+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.519+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.519+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.539+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.539+0000 7f3c119b9ec0 20 zone default found 2019-11-27T17:50:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.539+0000 7f3c119b9ec0 20 started sync module instance, tier type = 2019-11-27T17:50:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.539+0000 7f3c119b9ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T17:50:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=0 2019-11-27T17:50:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=1 2019-11-27T17:50:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=2 2019-11-27T17:50:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=3 2019-11-27T17:50:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=4 2019-11-27T17:50:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=5 2019-11-27T17:50:07.913 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:07.910+0000 7f3c119b9ec0 20 add_watcher() i=6 2019-11-27T17:50:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:08.030+0000 7f3c119b9ec0 20 add_watcher() i=7 2019-11-27T17:50:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:08.030+0000 7f3c119b9ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:50:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:08.030+0000 7f3bcf7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:50:08.040 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:08.039+0000 7f3bff3e7700 0 -- 172.21.15.5:0/177787320 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x56402b0cfa80 msgr2=0x56402b0cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T17:50:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:08.245+0000 7f3bff3e7700 0 --2- 172.21.15.5:0/177787320 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x56402b0cfa80 0x56402b0cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T17:50:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:08.299+0000 7f3bfebe6700 0 -- 172.21.15.5:0/2701059475 >> [v2:172.21.15.5:6800/8649,v1:172.21.15.5:6801/8649] conn(0x7f3b40017570 msgr2=0x7f3b40019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:50:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.155+0000 7f3b3dffb700 20 reqs_thread_entry: start 2019-11-27T17:50:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.156+0000 7f3b2f7fe700 20 reqs_thread_entry: start 2019-11-27T17:50:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.156+0000 7f3c119b9ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:50:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.157+0000 7f3b2dffb700 20 reqs_thread_entry: start 2019-11-27T17:50:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.157+0000 7f3c119b9ec0 20 get_system_obj_state: rctx=0x7fff1c0324b8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x56402b152a10 s->prefetch_data=0 2019-11-27T17:50:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.157+0000 7f3c119b9ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T17:50:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.174+0000 7f3c119b9ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-27T17:50:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.174+0000 7f3c119b9ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.174+0000 7f3c119b9ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T17:50:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.174+0000 7f3c119b9ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T17:50:10.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.174+0000 7f3c119b9ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T17:50:10.176 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.174+0000 7f3c119b9ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:10.192 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.191+0000 7f3c119b9ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-27T17:50:10.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.191+0000 7f3c119b9ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-27T17:50:10.193 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.191+0000 7f3c119b9ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:10.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.339+0000 7f3c119b9ec0 10 removing key index: IMQHLTPTLLIKTXVJSSTX 2019-11-27T17:50:10.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.339+0000 7f3c119b9ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=170 2019-11-27T17:50:10.370 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.369+0000 7f3bdffff700 10 RGWWatcher::handle_notify() notify_id 592705487020 cookie 94833600107600 notifier 5013 bl.length()=170 2019-11-27T17:50:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.750+0000 7f3c119b9ec0 10 removing email index: foo.client.0+test@test.test 2019-11-27T17:50:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.750+0000 7f3c119b9ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-11-27T17:50:10.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:10.774+0000 7f3bdffff700 10 RGWWatcher::handle_notify() notify_id 592705487382 cookie 94833600111568 notifier 5013 bl.length()=178 2019-11-27T17:50:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:11.494+0000 7f3c119b9ec0 10 removing user buckets index 2019-11-27T17:50:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:11.494+0000 7f3c119b9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-11-27T17:50:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:11.509+0000 7f3bdffff700 10 RGWWatcher::handle_notify() notify_id 592705487297 cookie 94833600101760 notifier 5013 bl.length()=169 2019-11-27T17:50:11.983 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:11.982+0000 7f3c119b9ec0 10 removing user index: foo.client.0 2019-11-27T17:50:11.983 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:11.982+0000 7f3c119b9ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-11-27T17:50:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:11.982+0000 7f3c119b9ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-11-27T17:50:12.010 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.009+0000 7f3bdffff700 10 RGWWatcher::handle_notify() notify_id 592705486927 cookie 94833600099776 notifier 5013 bl.length()=161 2019-11-27T17:50:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.541+0000 7f3c119b9ec0 20 remove_watcher() i=0 2019-11-27T17:50:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.541+0000 7f3c119b9ec0 2 removed watcher, disabling cache 2019-11-27T17:50:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.602+0000 7f3c119b9ec0 20 remove_watcher() i=1 2019-11-27T17:50:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.711+0000 7f3c119b9ec0 20 remove_watcher() i=2 2019-11-27T17:50:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.751+0000 7f3c119b9ec0 20 remove_watcher() i=3 2019-11-27T17:50:12.812 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.810+0000 7f3c119b9ec0 20 remove_watcher() i=4 2019-11-27T17:50:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:12.877+0000 7f3c119b9ec0 20 remove_watcher() i=5 2019-11-27T17:50:13.004 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.002+0000 7f3c119b9ec0 20 remove_watcher() i=6 2019-11-27T17:50:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.063+0000 7f3c119b9ec0 20 remove_watcher() i=7 2019-11-27T17:50:13.074 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-11-27T17:50:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.194+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.230+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.230+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.243 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.242+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.242+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.254+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.254+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.296+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.474+0000 7fc196ea6ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T17:50:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.474+0000 7fc196ea6ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T17:50:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.474+0000 7fc196ea6ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:50:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.474+0000 7fc196ea6ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:50:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.474+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.484+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.484+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.501+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.501+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.517 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.516+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:13.518 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.516+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.530+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.530+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.538+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.538+0000 7fc196ea6ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:50:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.538+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.546+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.547 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.546+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.654+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.654+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.675 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.673+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:13.675 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.673+0000 7fc196ea6ec0 20 zonegroup default 2019-11-27T17:50:13.675 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.673+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.686 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.685+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.685+0000 7fc196ea6ec0 10 Cannot find current period zone using local zone 2019-11-27T17:50:13.687 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.685+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.696+0000 7fc196ea6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.696+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.714+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.714+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.730+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.730+0000 7fc196ea6ec0 20 zone default found 2019-11-27T17:50:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.730+0000 7fc196ea6ec0 20 started sync module instance, tier type = 2019-11-27T17:50:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:13.730+0000 7fc196ea6ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T17:50:14.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=0 2019-11-27T17:50:14.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=1 2019-11-27T17:50:14.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=2 2019-11-27T17:50:14.147 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=3 2019-11-27T17:50:14.148 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=4 2019-11-27T17:50:14.148 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=5 2019-11-27T17:50:14.148 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.144+0000 7fc196ea6ec0 20 add_watcher() i=6 2019-11-27T17:50:14.187 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.185+0000 7fc196ea6ec0 20 add_watcher() i=7 2019-11-27T17:50:14.187 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.185+0000 7fc196ea6ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:50:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.185+0000 7fc154fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:50:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.199+0000 7fc1848d4700 0 -- >> v2:172.21.15.5:3300/0 conn(0x5619e56b5cc0 msgr2=0x5619e56b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:50:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:14.396+0000 7fc1848d4700 0 -- 172.21.15.5:0/4103518401 >> [v2:172.21.15.115:6800/9159,v1:172.21.15.115:6801/9159] conn(0x5619e56cb1b0 msgr2=0x5619e56cd5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:50:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.241+0000 7fc0c6ffd700 20 reqs_thread_entry: start 2019-11-27T17:50:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.242+0000 7fc0c4ff9700 20 reqs_thread_entry: start 2019-11-27T17:50:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.242+0000 7fc196ea6ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:50:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.242+0000 7fc0baffd700 20 reqs_thread_entry: start 2019-11-27T17:50:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.243+0000 7fc196ea6ec0 20 get_system_obj_state: rctx=0x7ffd554a4578 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x5619e5731a40 s->prefetch_data=0 2019-11-27T17:50:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.243+0000 7fc196ea6ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-27T17:50:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.260+0000 7fc196ea6ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-27T17:50:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.260+0000 7fc196ea6ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:50:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.260+0000 7fc196ea6ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T17:50:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.260+0000 7fc196ea6ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T17:50:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.260+0000 7fc196ea6ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T17:50:16.265 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.260+0000 7fc196ea6ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.279+0000 7fc196ea6ec0 20 rados_obj.operate() r=0 bl.length=505 2019-11-27T17:50:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.279+0000 7fc196ea6ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-27T17:50:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.279+0000 7fc196ea6ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:50:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.295+0000 7fc196ea6ec0 10 removing key index: DNORQZRPAJCBEDGWQHSV 2019-11-27T17:50:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.295+0000 7fc196ea6ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-11-27T17:50:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.308+0000 7fc179ffb700 10 RGWWatcher::handle_notify() notify_id 592705486928 cookie 94669223098304 notifier 5022 bl.length()=170 2019-11-27T17:50:16.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.646+0000 7fc196ea6ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-11-27T17:50:16.649 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.646+0000 7fc196ea6ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-11-27T17:50:16.665 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.659+0000 7fc179ffb700 10 RGWWatcher::handle_notify() notify_id 592705486929 cookie 94669223115328 notifier 5022 bl.length()=193 2019-11-27T17:50:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.919+0000 7fc196ea6ec0 10 removing user buckets index 2019-11-27T17:50:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.919+0000 7fc196ea6ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-11-27T17:50:16.939 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:16.937+0000 7fc179ffb700 10 RGWWatcher::handle_notify() notify_id 592705487383 cookie 94669223112080 notifier 5022 bl.length()=184 2019-11-27T17:50:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.208+0000 7fc196ea6ec0 10 removing user index: testx$tenanteduser.client.0 2019-11-27T17:50:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.208+0000 7fc196ea6ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-11-27T17:50:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.208+0000 7fc196ea6ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-11-27T17:50:17.229 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.227+0000 7fc179ffb700 10 RGWWatcher::handle_notify() notify_id 592705487298 cookie 94669223110992 notifier 5022 bl.length()=176 2019-11-27T17:50:17.545 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.543+0000 7fc196ea6ec0 20 remove_watcher() i=0 2019-11-27T17:50:17.546 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.543+0000 7fc196ea6ec0 2 removed watcher, disabling cache 2019-11-27T17:50:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.616+0000 7fc196ea6ec0 20 remove_watcher() i=1 2019-11-27T17:50:17.667 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.665+0000 7fc196ea6ec0 20 remove_watcher() i=2 2019-11-27T17:50:17.729 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.727+0000 7fc196ea6ec0 20 remove_watcher() i=3 2019-11-27T17:50:17.770 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.768+0000 7fc196ea6ec0 20 remove_watcher() i=4 2019-11-27T17:50:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.807+0000 7fc196ea6ec0 20 remove_watcher() i=5 2019-11-27T17:50:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.861+0000 7fc196ea6ec0 20 remove_watcher() i=6 2019-11-27T17:50:17.924 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:17.922+0000 7fc196ea6ec0 20 remove_watcher() i=7 2019-11-27T17:50:17.931 INFO:tasks.s3tests:Removing s3-tests... 2019-11-27T17:50:17.932 INFO:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-11-27T17:50:18.069 INFO:teuthology.run_tasks:Running task swift... 2019-11-27T17:50:18.090 INFO:tasks.swift:clients=['client.0'] 2019-11-27T17:50:18.091 INFO:tasks.swift:Downloading swift... 2019-11-27T17:50:18.091 INFO:teuthology.orchestra.run.smithi005:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-11-27T17:50:18.195 INFO:teuthology.orchestra.run.smithi005.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-11-27T17:50:18.584 INFO:tasks.swift:Creating rgw users... 2019-11-27T17:50:18.584 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret alU3dDEYd5VxVl9t/3eyK4P1WNJ9OdY3Mi+4mRq6e6zvyBPLwP4Ggg== --email foo.client.0+test@test.test --key-type swift --access full 2019-11-27T17:50:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.730+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:18.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.764+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:18.766 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.764+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:18.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.772+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:18.775 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.772+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:18.782 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.780+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:18.782 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.780+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:18.801 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:18.799+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.044+0000 7fa5ff345ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T17:50:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.044+0000 7fa5ff345ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T17:50:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.044+0000 7fa5ff345ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:50:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.044+0000 7fa5ff345ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:50:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.044+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.058+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:19.060 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.058+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.077 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.075+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:19.078 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.075+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.089+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:19.091 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.089+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.105 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.103+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:19.106 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.103+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.110+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.110+0000 7fa5ff345ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:50:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.110+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.118+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.118+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.127+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.127+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.141+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.141+0000 7fa5ff345ec0 20 zonegroup default 2019-11-27T17:50:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.141+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.152+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.152+0000 7fa5ff345ec0 10 Cannot find current period zone using local zone 2019-11-27T17:50:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.152+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.162+0000 7fa5ff345ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.162+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.171+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:19.173 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.171+0000 7fa5ff345ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.188+0000 7fa5ff345ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.188+0000 7fa5ff345ec0 20 zone default found 2019-11-27T17:50:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.188+0000 7fa5ff345ec0 20 started sync module instance, tier type = 2019-11-27T17:50:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.188+0000 7fa5ff345ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T17:50:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=0 2019-11-27T17:50:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=1 2019-11-27T17:50:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=2 2019-11-27T17:50:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=3 2019-11-27T17:50:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=4 2019-11-27T17:50:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=5 2019-11-27T17:50:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.571+0000 7fa5ff345ec0 20 add_watcher() i=6 2019-11-27T17:50:19.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.600+0000 7fa5ff345ec0 20 add_watcher() i=7 2019-11-27T17:50:19.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.600+0000 7fa5ff345ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:50:19.603 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.600+0000 7fa5bcfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:50:19.605 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.604+0000 7fa5e3d71700 0 -- 172.21.15.5:0/3324508139 >> v2:172.21.15.115:3300/0 conn(0x5603bb653210 msgr2=0x5603bb655700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T17:50:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:19.638+0000 7fa5e3d71700 0 -- 172.21.15.5:0/3384638297 >> [v2:172.21.15.115:6824/9158,v1:172.21.15.115:6825/9158] conn(0x5603bb664440 msgr2=0x5603bb666860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T17:50:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.340+0000 7fa52effd700 20 reqs_thread_entry: start 2019-11-27T17:50:21.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.340+0000 7fa52cff9700 20 reqs_thread_entry: start 2019-11-27T17:50:21.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.340+0000 7fa5ff345ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:50:21.342 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.341+0000 7fa522ffd700 20 reqs_thread_entry: start 2019-11-27T17:50:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.341+0000 7fa5ff345ec0 20 get_system_obj_state: rctx=0x7fff7d226318 obj=default.rgw.meta:users.uid:foo.client.0 state=0x5603bb6cdc70 s->prefetch_data=0 2019-11-27T17:50:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.341+0000 7fa5ff345ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T17:50:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.350+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-27T17:50:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.350+0000 7fa5ff345ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.350+0000 7fa5ff345ec0 20 get_system_obj_state: rctx=0x7fff7d226328 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x5603bb6cfa00 s->prefetch_data=0 2019-11-27T17:50:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.350+0000 7fa5ff345ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-27T17:50:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.362+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-27T17:50:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.362+0000 7fa5ff345ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T17:50:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.362+0000 7fa5ff345ec0 20 get_system_obj_state: rctx=0x7fff7d225f38 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x5603bb6cfa00 s->prefetch_data=0 2019-11-27T17:50:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.362+0000 7fa5ff345ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-11-27T17:50:21.371 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.370+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-27T17:50:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.370+0000 7fa5ff345ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T17:50:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.370+0000 7fa5ff345ec0 20 get_system_obj_state: rctx=0x7fff7d2260b8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x5603bb6cfcb0 s->prefetch_data=0 2019-11-27T17:50:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.370+0000 7fa5ff345ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-11-27T17:50:21.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.380+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-27T17:50:21.381 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.380+0000 7fa5ff345ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T17:50:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.444+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:50:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.444+0000 7fa5ff345ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.444+0000 7fa5ff345ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-11-27T17:50:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.461+0000 7fa5e1d6d700 10 RGWWatcher::handle_notify() notify_id 592705486930 cookie 94574028765424 notifier 4691 bl.length()=612 2019-11-27T17:50:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.461+0000 7fa5e1d6d700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:50:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.461+0000 7fa5e1d6d700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.640+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T17:50:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.640+0000 7fa5ff345ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T17:50:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.640+0000 7fa5ff345ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-27T17:50:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.657+0000 7fa5e1d6d700 10 RGWWatcher::handle_notify() notify_id 592705487384 cookie 94574028780288 notifier 4691 bl.length()=194 2019-11-27T17:50:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.657+0000 7fa5e1d6d700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T17:50:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:21.657+0000 7fa5e1d6d700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T17:50:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.419+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-27T17:50:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.419+0000 7fa5ff345ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T17:50:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.419+0000 7fa5ff345ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-11-27T17:50:22.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.432+0000 7fa5e1d6d700 10 RGWWatcher::handle_notify() notify_id 592705487299 cookie 94574028767472 notifier 4691 bl.length()=183 2019-11-27T17:50:22.433 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.432+0000 7fa5e1d6d700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-27T17:50:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.432+0000 7fa5e1d6d700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T17:50:22.622 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.621+0000 7fa5ff345ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:50:22.623 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.621+0000 7fa5ff345ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:22.623 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.621+0000 7fa5ff345ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-11-27T17:50:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.636+0000 7fa5e1d6d700 10 RGWWatcher::handle_notify() notify_id 592705486931 cookie 94574028765424 notifier 4691 bl.length()=636 2019-11-27T17:50:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.636+0000 7fa5e1d6d700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:50:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.636+0000 7fa5e1d6d700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:50:22.713 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T17:50:22.714 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "foo.client.0", 2019-11-27T17:50:22.714 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. foo.client.0 foo", 2019-11-27T17:50:22.714 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "foo.client.0+test@test.test", 2019-11-27T17:50:22.714 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T17:50:22.714 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [ 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "foo.client.0:foo", 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: "permissions": "full-control" 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T17:50:22.715 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [], 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [ 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "foo.client.0:foo", 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "alU3dDEYd5VxVl9t/3eyK4P1WNJ9OdY3Mi+4mRq6e6zvyBPLwP4Ggg==" 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T17:50:22.716 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T17:50:22.717 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T17:50:22.717 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T17:50:22.717 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T17:50:22.717 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T17:50:22.717 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T17:50:22.717 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T17:50:22.718 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T17:50:22.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T17:50:22.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T17:50:22.720 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T17:50:22.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T17:50:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.743+0000 7fa5ff345ec0 20 remove_watcher() i=0 2019-11-27T17:50:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.743+0000 7fa5ff345ec0 2 removed watcher, disabling cache 2019-11-27T17:50:22.793 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.792+0000 7fa5ff345ec0 20 remove_watcher() i=1 2019-11-27T17:50:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.833+0000 7fa5ff345ec0 20 remove_watcher() i=2 2019-11-27T17:50:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.887+0000 7fa5ff345ec0 20 remove_watcher() i=3 2019-11-27T17:50:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.942+0000 7fa5ff345ec0 20 remove_watcher() i=4 2019-11-27T17:50:22.986 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:22.985+0000 7fa5ff345ec0 20 remove_watcher() i=5 2019-11-27T17:50:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.038+0000 7fa5ff345ec0 20 remove_watcher() i=6 2019-11-27T17:50:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.087+0000 7fa5ff345ec0 20 remove_watcher() i=7 2019-11-27T17:50:23.097 INFO:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret bknTuvboHn1oVlSEu3iU6p30/RufG1YsjLR53l9jBXmWu6lhVVUVfw== --email bar.client.0+test@test.test --key-type swift --access full 2019-11-27T17:50:23.293 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.292+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.336 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.334+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.336 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.334+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.344+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.344+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.351+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.351+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.370+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.579+0000 7f3292ba4ec0 20 RGWRados::pool_iterate: got zone_info.dc4084cb-262b-4d5b-9664-fa175bfdb24a 2019-11-27T17:50:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.579+0000 7f3292ba4ec0 20 RGWRados::pool_iterate: got zonegroup_info.602c3968-35b7-4b9f-8f75-acb87162fa21 2019-11-27T17:50:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.579+0000 7f3292ba4ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:50:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.579+0000 7f3292ba4ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:50:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.579+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.601 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.600+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.600+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.626+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.626+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.643 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.640+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:23.644 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.640+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.650+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.650+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.656+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.656+0000 7f3292ba4ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:50:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.656+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.669+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.670 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.669+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.682+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.682+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.705 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.701+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:50:23.705 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.701+0000 7f3292ba4ec0 20 zonegroup default 2019-11-27T17:50:23.705 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.701+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.713+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.713+0000 7f3292ba4ec0 10 Cannot find current period zone using local zone 2019-11-27T17:50:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.713+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.726 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.724+0000 7f3292ba4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:50:23.726 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.725+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.738+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:50:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.738+0000 7f3292ba4ec0 20 rados->read ofs=0 len=0 2019-11-27T17:50:23.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.752+0000 7f3292ba4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:50:23.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.752+0000 7f3292ba4ec0 20 zone default found 2019-11-27T17:50:23.753 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.752+0000 7f3292ba4ec0 20 started sync module instance, tier type = 2019-11-27T17:50:23.754 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:23.752+0000 7f3292ba4ec0 20 started zone id=dc4084cb-262b-4d5b-9664-fa175bfdb24a (name=default) with tier type = 2019-11-27T17:50:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=0 2019-11-27T17:50:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=1 2019-11-27T17:50:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=2 2019-11-27T17:50:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=3 2019-11-27T17:50:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=4 2019-11-27T17:50:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=5 2019-11-27T17:50:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.136+0000 7f3292ba4ec0 20 add_watcher() i=6 2019-11-27T17:50:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.179+0000 7f3292ba4ec0 20 add_watcher() i=7 2019-11-27T17:50:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.179+0000 7f3292ba4ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:50:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.179+0000 7f31d3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:50:24.183 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.182+0000 7f327f5d0700 0 -- 172.21.15.5:0/203259275 >> v1:172.21.15.5:6789/0 conn(0x55d9b43b7b40 legacy=0x55d9b43ba050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T17:50:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:24.218+0000 7f327f5d0700 0 -- 172.21.15.5:0/997062099 >> [v2:172.21.15.115:6824/9158,v1:172.21.15.115:6825/9158] conn(0x55d9b43c8cb0 msgr2=0x55d9b43cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:50:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.129+0000 7f31be7fc700 20 reqs_thread_entry: start 2019-11-27T17:50:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.130+0000 7f31b7fff700 20 reqs_thread_entry: start 2019-11-27T17:50:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.130+0000 7f3292ba4ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:50:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.130+0000 7f31b67fc700 20 reqs_thread_entry: start 2019-11-27T17:50:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.130+0000 7f3292ba4ec0 20 get_system_obj_state: rctx=0x7fffeb340948 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55d9b44325b0 s->prefetch_data=0 2019-11-27T17:50:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.130+0000 7f3292ba4ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T17:50:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.138+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-27T17:50:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.138+0000 7f3292ba4ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.138+0000 7f3292ba4ec0 20 get_system_obj_state: rctx=0x7fffeb340958 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55d9b4434340 s->prefetch_data=0 2019-11-27T17:50:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.138+0000 7f3292ba4ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-27T17:50:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.144+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-27T17:50:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.144+0000 7f3292ba4ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T17:50:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.144+0000 7f3292ba4ec0 20 get_system_obj_state: rctx=0x7fffeb340568 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x55d9b4434340 s->prefetch_data=0 2019-11-27T17:50:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.144+0000 7f3292ba4ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-11-27T17:50:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.151+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-27T17:50:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.151+0000 7f3292ba4ec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T17:50:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.151+0000 7f3292ba4ec0 20 get_system_obj_state: rctx=0x7fffeb3406e8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x55d9b44345f0 s->prefetch_data=0 2019-11-27T17:50:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.151+0000 7f3292ba4ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-11-27T17:50:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.159+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-27T17:50:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.159+0000 7f3292ba4ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T17:50:26.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.209+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:50:26.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.209+0000 7f3292ba4ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:26.210 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.209+0000 7f3292ba4ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-11-27T17:50:26.225 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.224+0000 7f32657fa700 10 RGWWatcher::handle_notify() notify_id 592705487300 cookie 94393519972688 notifier 5046 bl.length()=612 2019-11-27T17:50:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.224+0000 7f32657fa700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:50:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.224+0000 7f32657fa700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.461+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T17:50:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.461+0000 7f3292ba4ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T17:50:26.463 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.461+0000 7f3292ba4ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-27T17:50:26.480 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.479+0000 7f32657fa700 10 RGWWatcher::handle_notify() notify_id 592705487301 cookie 94393519972688 notifier 5046 bl.length()=194 2019-11-27T17:50:26.481 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.479+0000 7f32657fa700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T17:50:26.481 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.479+0000 7f32657fa700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T17:50:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.714+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-27T17:50:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.714+0000 7f3292ba4ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T17:50:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.714+0000 7f3292ba4ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-11-27T17:50:26.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.732+0000 7f32657fa700 10 RGWWatcher::handle_notify() notify_id 592705487302 cookie 94393519981968 notifier 5046 bl.length()=183 2019-11-27T17:50:26.733 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.732+0000 7f32657fa700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-27T17:50:26.734 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:26.732+0000 7f32657fa700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T17:50:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.080+0000 7f3292ba4ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:50:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.080+0000 7f3292ba4ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.080+0000 7f3292ba4ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-11-27T17:50:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.100+0000 7f32657fa700 10 RGWWatcher::handle_notify() notify_id 592705487303 cookie 94393519972688 notifier 5046 bl.length()=636 2019-11-27T17:50:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.100+0000 7f32657fa700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:50:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.100+0000 7f32657fa700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:50:27.693 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2019-11-27T17:50:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "user_id": "bar.client.0", 2019-11-27T17:50:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "display_name": "Mr. bar.client.0 bar", 2019-11-27T17:50:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "email": "bar.client.0+test@test.test", 2019-11-27T17:50:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "suspended": 0, 2019-11-27T17:50:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "max_buckets": 1000, 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "subusers": [ 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "bar.client.0:bar", 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "permissions": "full-control" 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "keys": [], 2019-11-27T17:50:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "swift_keys": [ 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "user": "bar.client.0:bar", 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "bknTuvboHn1oVlSEu3iU6p30/RufG1YsjLR53l9jBXmWu6lhVVUVfw==" 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": [], 2019-11-27T17:50:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "op_mask": "read, write, delete", 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "default_storage_class": "", 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_tags": [], 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T17:50:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2019-11-27T17:50:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "temp_url_keys": [], 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "rgw", 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mfa_ids": [] 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:} 2019-11-27T17:50:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T17:50:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.739+0000 7f3292ba4ec0 20 remove_watcher() i=0 2019-11-27T17:50:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.739+0000 7f3292ba4ec0 2 removed watcher, disabling cache 2019-11-27T17:50:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.788+0000 7f3292ba4ec0 20 remove_watcher() i=1 2019-11-27T17:50:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.837+0000 7f3292ba4ec0 20 remove_watcher() i=2 2019-11-27T17:50:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.902+0000 7f3292ba4ec0 20 remove_watcher() i=3 2019-11-27T17:50:27.951 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.949+0000 7f3292ba4ec0 20 remove_watcher() i=4 2019-11-27T17:50:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:27.995+0000 7f3292ba4ec0 20 remove_watcher() i=5 2019-11-27T17:50:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:28.050+0000 7f3292ba4ec0 20 remove_watcher() i=6 2019-11-27T17:50:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2019-11-27T17:50:28.099+0000 7f3292ba4ec0 20 remove_watcher() i=7 2019-11-27T17:50:28.111 INFO:tasks.swift:Configuring testswift... 2019-11-27T17:50:28.112 INFO:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-11-27T17:50:30.942 INFO:teuthology.orchestra.run.smithi005.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-11-27T17:50:32.583 INFO:teuthology.orchestra.run.smithi005.stdout:Installing setuptools, pip, wheel...done. 2019-11-27T17:50:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:Cache entry deserialization failed, entry ignored 2019-11-27T17:50:33.053 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting pip 2019-11-27T17:50:33.178 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-27T17:50:33.272 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: pip 2019-11-27T17:50:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: pip 9.0.1 2019-11-27T17:50:33.353 INFO:teuthology.orchestra.run.smithi005.stdout: Uninstalling pip-9.0.1: 2019-11-27T17:50:33.397 INFO:teuthology.orchestra.run.smithi005.stdout: Successfully uninstalled pip-9.0.1 2019-11-27T17:50:34.253 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed pip-19.3.1 2019-11-27T17:50:34.568 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T17:50:35.071 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting setuptools==32.3.1 2019-11-27T17:50:35.074 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-27T17:50:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: setuptools 2019-11-27T17:50:35.116 INFO:teuthology.orchestra.run.smithi005.stdout: Found existing installation: setuptools 28.8.0 2019-11-27T17:50:35.131 INFO:teuthology.orchestra.run.smithi005.stdout: Uninstalling setuptools-28.8.0: 2019-11-27T17:50:35.140 INFO:teuthology.orchestra.run.smithi005.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-27T17:50:35.269 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed setuptools-32.3.1 2019-11-27T17:50:35.705 INFO:teuthology.orchestra.run.smithi005.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T17:50:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-27T17:50:35.988 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting nose>=1.0.0 2019-11-27T17:50:35.991 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-27T17:50:36.128 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting boto>=2.0b4 2019-11-27T17:50:36.135 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-27T17:50:36.304 INFO:teuthology.orchestra.run.smithi005.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-27T17:50:36.624 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting gevent>=0.14 2019-11-27T17:50:36.639 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T17:50:36.905 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting isodate>=0.4.4 2019-11-27T17:50:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-11-27T17:50:36.984 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting eventlet>=0.9.14 2019-11-27T17:50:37.037 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-11-27T17:50:37.272 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting netifaces>=0.5 2019-11-27T17:50:37.282 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T17:50:37.385 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting xattr<0.7.0,>=0.6 2019-11-27T17:50:37.396 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-11-27T17:50:37.842 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting simplejson>=2.1.3 2019-11-27T17:50:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-11-27T17:50:38.214 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting WebOb==1.0 2019-11-27T17:50:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-11-27T17:50:38.626 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-27T17:50:38.628 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T17:50:38.814 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting six 2019-11-27T17:50:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-27T17:50:38.898 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting monotonic>=1.4 2019-11-27T17:50:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-11-27T17:50:38.998 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting dnspython>=1.15.0 2019-11-27T17:50:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-11-27T17:50:39.175 INFO:teuthology.orchestra.run.smithi005.stdout:Collecting enum34; python_version < "3.4" 2019-11-27T17:50:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-11-27T17:50:39.219 INFO:teuthology.orchestra.run.smithi005.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-11-27T17:50:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for xattr (setup.py): started 2019-11-27T17:50:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-11-27T17:50:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24122 sha256=cbec4fdcb65a851b327beb10d898097caba8a6f2bd0de6c8eee4bf81c126a83b 2019-11-27T17:50:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-11-27T17:50:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for simplejson (setup.py): started 2019-11-27T17:50:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-11-27T17:50:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113124 sha256=4210ec36cea017a1e5a71b29e4b3b24cae332b5a7ff446dfd04f80d721d58a04 2019-11-27T17:50:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-11-27T17:50:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for WebOb (setup.py): started 2019-11-27T17:50:41.075 INFO:teuthology.orchestra.run.smithi005.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-11-27T17:50:41.076 INFO:teuthology.orchestra.run.smithi005.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=e493e8a738e84a9482d602926562589672337c7f4aa742917ccaf3ae0c2ff9d8 2019-11-27T17:50:41.076 INFO:teuthology.orchestra.run.smithi005.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-11-27T17:50:41.087 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully built xattr simplejson WebOb 2019-11-27T17:50:41.149 INFO:teuthology.orchestra.run.smithi005.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-11-27T17:50:42.563 INFO:teuthology.orchestra.run.smithi005.stdout:Successfully installed PyYAML-5.1.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-11-27T17:50:42.835 INFO:teuthology.orchestra.run.smithi005.stdout:running develop 2019-11-27T17:50:42.883 INFO:teuthology.orchestra.run.smithi005.stdout:running egg_info 2019-11-27T17:50:42.883 INFO:teuthology.orchestra.run.smithi005.stdout:creating swift.egg-info 2019-11-27T17:50:42.884 INFO:teuthology.orchestra.run.smithi005.stdout:writing swift.egg-info/PKG-INFO 2019-11-27T17:50:42.884 INFO:teuthology.orchestra.run.smithi005.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-11-27T17:50:42.884 INFO:teuthology.orchestra.run.smithi005.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-11-27T17:50:42.887 INFO:teuthology.orchestra.run.smithi005.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-11-27T17:50:42.887 INFO:teuthology.orchestra.run.smithi005.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-27T17:50:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-11-27T17:50:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:reading manifest template 'MANIFEST.in' 2019-11-27T17:50:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:warning: no files found matching 'ChangeLog' 2019-11-27T17:50:42.894 INFO:teuthology.orchestra.run.smithi005.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-27T17:50:42.896 INFO:teuthology.orchestra.run.smithi005.stdout:running build_ext 2019-11-27T17:50:42.896 INFO:teuthology.orchestra.run.smithi005.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-11-27T17:50:42.896 INFO:teuthology.orchestra.run.smithi005.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-11-27T17:50:42.912 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.913 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.916 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.917 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.917 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.918 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.919 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.920 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.921 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.922 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.922 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.924 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.925 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.926 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.927 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.928 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.929 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.930 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.931 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.931 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.932 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.936 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.938 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.944 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.945 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.947 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.949 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.951 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.953 INFO:teuthology.orchestra.run.smithi005.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T17:50:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2019-11-27T17:50:42.953 INFO:teuthology.orchestra.run.smithi005.stdout:Installed /home/ubuntu/cephtest/swift 2019-11-27T17:50:42.953 INFO:teuthology.orchestra.run.smithi005.stdout:Processing dependencies for swift==1.4.4 2019-11-27T17:50:42.954 INFO:teuthology.orchestra.run.smithi005.stdout:Finished processing dependencies for swift==1.4.4 2019-11-27T17:50:42.965 INFO:teuthology.orchestra.run.smithi005:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-11-27T17:50:43.012 INFO:teuthology.orchestra.run.smithi005:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-11-27T17:51:10.762 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:56:44.825 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.767 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:56:44.831 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.778 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:56:44.841 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.783 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:56:44.846 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.788 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:56:44.798 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.803 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:56:44.812 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.896 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:04:56:44.960 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.914 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:04:56:44.977 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:10.956 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:04:56:44.967 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:51:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-11-27T17:51:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-11-27T17:54:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-11-27T17:55:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-11-27T17:55:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-11-27T17:55:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-11-27T17:55:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-11-27T17:56:22.992 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:01:57.052 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:22.998 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:01:57.061 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.004 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:01:57.068 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.007 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:01:57.071 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.011 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:01:57.021 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.017 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:01:57.028 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.228 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:01:57.291 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.255 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:01:57.265 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:23.279 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:01:57.342 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:24.876 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:01:58.939 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:24.877 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:01:58.887 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:24.877 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:01:58.940 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:24.878 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:01:58.889 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:24.893 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:01:58.902 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:24.893 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:01:58.951 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:25.030 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:01:59.093 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:25.036 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:01:59.095 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:25.045 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:01:59.104 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:55.122 INFO:teuthology.orchestra.run.smithi005.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-11-27T17:56:55.186 INFO:teuthology.orchestra.run.smithi005.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-11-27T18:00:40.472 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:06:14.536 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.491 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:06:14.554 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.592 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:06:14.602 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.593 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:06:14.657 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.594 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:06:14.605 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.597 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:06:14.660 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.678 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:06:14.742 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.824 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:06:14.888 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:00:40.848 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:06:14.859 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.757 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:07:05.820 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.766 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:07:05.828 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.780 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:07:05.844 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.786 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:07:05.849 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.792 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:07:05.803 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.809 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:07:05.819 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.837 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:07:05.900 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.857 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:07:05.920 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:01:31.906 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:07:05.917 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-11-27T18:02:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-11-27T18:02:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:02:58.693 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:04:46.270 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:10:20.333 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.312 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:10:20.375 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.322 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:10:20.385 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.345 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:10:20.356 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.349 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:10:20.413 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.350 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:10:20.361 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:10:20.488 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.439 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:10:20.502 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:46.477 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:10:20.488 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.257 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:12:17.320 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.260 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:12:17.323 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.280 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:12:17.343 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.286 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:12:17.297 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.288 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:12:17.351 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.292 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:12:17.303 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.360 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:12:17.423 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.384 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:12:17.447 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:06:43.385 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:12:17.395 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:08:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:08:16.721 INFO:teuthology.orchestra.run.smithi005.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:08:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:09:03.130 INFO:teuthology.orchestra.run.smithi005.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:11:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:11:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T18:11:53.627 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:17:27.690 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.635 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:17:27.698 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.645 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:17:27.708 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.650 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:17:27.661 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.653 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:17:27.716 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.659 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:17:27.669 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.832 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:17:27.895 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.842 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:17:27.905 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:11:53.869 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:17:27.879 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.859 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:18:41.922 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.866 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:18:41.929 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.903 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:18:41.966 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.912 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:18:41.975 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.915 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:18:41.978 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.925 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:18:41.935 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.933 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:18:41.943 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.958 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:18:42.021 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:07.994 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:18:42.005 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.654 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:22:39.716 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.670 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:22:39.733 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.670 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:22:39.733 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.673 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:22:39.683 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.678 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:22:39.741 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.683 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:22:39.693 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.856 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:22:39.867 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.862 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:22:39.925 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:17:05.866 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:22:39.929 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:19:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:07.489 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:11.856 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:23.666 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:43.571 INFO:teuthology.orchestra.run.smithi005.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-11-27T18:19:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T18:21:29.612 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:27:03.675 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.633 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:27:03.696 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.650 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:27:03.713 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.669 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:27:03.732 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.717 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:27:03.728 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.729 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:27:03.739 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.757 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:27:03.820 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.807 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:27:03.870 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:29.976 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:27:03.986 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-11-27T18:21:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-11-27T18:21:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-11-27T18:22:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-11-27T18:22:17.172 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:27:51.235 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.182 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:27:51.246 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.193 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:27:51.256 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.199 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:27:51.263 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.206 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:27:51.216 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.217 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:27:51.227 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.242 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:27:51.305 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.261 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:27:51.324 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:17.343 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:27:51.354 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:22:36.362 INFO:teuthology.orchestra.run.smithi005.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-11-27T18:23:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-11-27T18:23:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-11-27T18:24:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-11-27T18:27:30.095 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:33:04.158 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.105 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:33:04.168 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.113 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:33:04.123 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.116 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:33:04.178 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.117 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:33:04.128 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.123 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:33:04.186 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.318 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:33:04.381 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.338 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:33:04.400 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:27:30.343 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:33:04.354 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-11-27T18:29:26.227 INFO:teuthology.orchestra.run.smithi005.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-11-27T18:29:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-11-27T18:31:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:28.374 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:32.954 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:31:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:32:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:32:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:32:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:32:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:32:41.658 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:38:15.720 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.254 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:38:15.707 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.254 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:38:15.713 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.254 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:38:15.964 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.254 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:38:15.729 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.254 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:38:15.910 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.254 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:38:15.739 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.255 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:38:15.744 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:01.255 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:38:15.921 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:33:47.113 INFO:teuthology.orchestra.run.smithi005.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:33:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:34:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:34:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:34:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:36:00.812 INFO:teuthology.orchestra.run.smithi005.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:36:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:37:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T18:37:52.592 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:43:26.655 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.598 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:43:26.660 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.610 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:43:26.619 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.610 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:43:26.672 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.615 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:43:26.677 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.616 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:43:26.625 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.799 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:43:26.809 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.835 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:43:26.897 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:37:52.846 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:43:26.909 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.650 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:43:46.713 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.689 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:43:46.751 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.711 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:43:46.721 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.712 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:43:46.775 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.713 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:43:46.776 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.717 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:43:46.780 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.738 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:43:46.749 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.742 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:43:46.805 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:12.795 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:43:46.805 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-11-27T18:41:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-11-27T18:41:38.578 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:47:12.640 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.609 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:47:12.672 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.638 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:47:12.701 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.663 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:47:12.725 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.674 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:47:12.684 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.684 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:47:12.694 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.771 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:47:12.834 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.807 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:47:12.817 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:38.811 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:47:12.874 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:41:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-11-27T18:41:42.411 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-11-27T18:42:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T18:42:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T18:43:00.293 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T18:43:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T18:43:03.840 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:48:37.901 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.850 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:48:37.912 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.858 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:48:37.920 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.863 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:48:37.873 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.863 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:48:37.926 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.872 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:48:37.882 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.925 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:48:37.987 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.944 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:48:38.006 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:03.974 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:48:37.984 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:43:42.174 INFO:teuthology.orchestra.run.smithi005.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-11-27T18:43:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-11-27T18:46:39.434 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:52:13.496 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.442 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:52:13.504 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.455 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:52:13.465 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.457 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:52:13.468 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.474 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:52:13.536 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.477 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:52:13.540 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.551 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:52:13.561 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.591 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:52:13.653 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:39.617 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:52:13.680 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.885 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:53:48.948 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.892 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:53:48.955 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.903 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:53:48.965 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.909 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:53:48.971 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.914 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:53:48.924 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.980 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:53:48.990 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:14.998 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:53:49.060 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:15.015 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:53:49.078 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:48:15.078 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:53:49.088 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.004 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:59:02.066 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.014 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:59:02.076 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.019 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:59:02.081 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.026 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:59:02.089 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.037 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:59:02.047 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.052 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:59:02.062 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.208 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:05:59:02.270 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.217 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:05:59:02.279 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:53:28.272 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:05:59:02.282 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.120 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:00:35.182 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.157 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:00:35.219 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.174 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:00:35.236 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.183 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:00:35.246 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.189 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:00:35.199 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.196 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:00:35.206 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.216 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:00:35.278 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.240 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:00:35.302 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:01.293 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:00:35.303 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:21.349 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T18:58:21.336+0000 1694c700 -1 osd.4 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:40.600110+0000 front 2019-11-27T18:57:38.745982+0000 (oldest deadline 2019-11-27T18:58:20.551718+0000) 2019-11-27T18:58:21.827 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T18:58:21.817+0000 1694c700 -1 osd.3 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:38.872138+0000 front 2019-11-27T18:57:38.929657+0000 (oldest deadline 2019-11-27T18:58:21.302298+0000) 2019-11-27T18:58:22.290 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T18:58:22.281+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.879901+0000 front 2019-11-27T18:57:40.563499+0000 (oldest deadline 2019-11-27T18:58:22.104248+0000) 2019-11-27T18:58:22.335 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T18:58:22.327+0000 1694c700 -1 osd.4 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:40.600110+0000 front 2019-11-27T18:57:38.745982+0000 (oldest deadline 2019-11-27T18:58:20.551718+0000) 2019-11-27T18:58:22.774 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T18:58:22.761+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.817468+0000 front 2019-11-27T18:57:39.755078+0000 (oldest deadline 2019-11-27T18:58:22.632944+0000) 2019-11-27T18:58:22.861 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T18:58:22.855+0000 1694c700 -1 osd.3 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:38.872138+0000 front 2019-11-27T18:57:38.929657+0000 (oldest deadline 2019-11-27T18:58:21.302298+0000) 2019-11-27T18:58:23.322 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T18:58:23.316+0000 1694c700 -1 osd.4 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:40.600110+0000 front 2019-11-27T18:57:38.745982+0000 (oldest deadline 2019-11-27T18:58:20.551718+0000) 2019-11-27T18:58:23.341 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T18:58:23.335+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.879901+0000 front 2019-11-27T18:57:40.563499+0000 (oldest deadline 2019-11-27T18:58:22.104248+0000) 2019-11-27T18:58:23.766 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T18:58:23.760+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.817468+0000 front 2019-11-27T18:57:39.755078+0000 (oldest deadline 2019-11-27T18:58:22.632944+0000) 2019-11-27T18:58:23.830 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T18:58:23.819+0000 1694c700 -1 osd.3 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:38.872138+0000 front 2019-11-27T18:57:38.929657+0000 (oldest deadline 2019-11-27T18:58:21.302298+0000) 2019-11-27T18:58:24.363 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T18:58:24.357+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.879901+0000 front 2019-11-27T18:57:40.563499+0000 (oldest deadline 2019-11-27T18:58:22.104248+0000) 2019-11-27T18:58:24.387 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T18:58:24.359+0000 1694c700 -1 osd.6 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.269754+0000 front 2019-11-27T18:57:39.250630+0000 (oldest deadline 2019-11-27T18:58:23.932439+0000) 2019-11-27T18:58:24.389 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T18:58:24.370+0000 1694c700 -1 osd.4 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:40.600110+0000 front 2019-11-27T18:57:38.745982+0000 (oldest deadline 2019-11-27T18:58:20.551718+0000) 2019-11-27T18:58:24.768 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:58:24.757+0000 1694c700 -1 osd.7 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:38.753355+0000 front 2019-11-27T18:57:38.749646+0000 (oldest deadline 2019-11-27T18:58:23.752439+0000) 2019-11-27T18:58:24.783 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T18:58:24.779+0000 1694c700 -1 osd.3 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:38.872138+0000 front 2019-11-27T18:57:38.929657+0000 (oldest deadline 2019-11-27T18:58:21.302298+0000) 2019-11-27T18:58:24.822 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T18:58:24.816+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.817468+0000 front 2019-11-27T18:57:39.755078+0000 (oldest deadline 2019-11-27T18:58:22.632944+0000) 2019-11-27T18:58:25.225 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T18:58:25.215+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:40.187527+0000 front 2019-11-27T18:57:40.585843+0000 (oldest deadline 2019-11-27T18:58:24.856626+0000) 2019-11-27T18:58:25.773 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:58:25.769+0000 1694c700 -1 osd.7 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:38.753355+0000 front 2019-11-27T18:57:38.749646+0000 (oldest deadline 2019-11-27T18:58:23.752439+0000) 2019-11-27T18:58:25.806 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T18:58:25.800+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T18:57:39.817468+0000 front 2019-11-27T18:57:39.755078+0000 (oldest deadline 2019-11-27T18:58:22.632944+0000) 2019-11-27T18:58:31.068 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:04:05.130 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.082 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:04:05.144 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.093 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:04:05.155 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.098 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:04:05.160 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.101 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:04:05.111 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.114 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:04:05.123 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.253 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:04:05.310 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.292 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:04:05.301 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T18:58:31.320 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:04:05.382 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:22.166 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:22.158+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:22.817 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:22.809+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:23.219 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:23.215+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:23.833 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:23.828+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:24.244 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:24.239+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:24.826 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:24.822+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:25.280 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:25.276+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:25.859 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:25.855+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:26.314 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:26.310+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:26.852 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:26.848+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:27.305 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:27.300+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:27.867 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:27.862+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:28.290 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:28.287+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:28.821 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:28.817+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:29.310 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:29.307+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:29.849 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:29.845+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:30.299 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:30.295+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:30.897 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:30.892+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:31.281 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:31.278+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:31.928 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:31.924+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:32.314 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:32.310+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:32.977 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:32.972+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:33.359 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:33.354+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:33.968 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:33.964+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:34.338 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:34.332+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:35.009 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:35.005+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:35.302 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:35.296+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:36.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:36.018+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:36.322 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:36.318+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:37.011 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:37.008+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:37.349 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:37.344+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:37.978 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:37.974+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:38.377 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:38.372+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:38.998 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:38.994+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:39.361 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:39.357+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:40.031 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:40.026+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:40.410 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:40.405+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:41.065 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:41.061+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:41.372 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:41.368+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:42.096 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:42.090+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:42.395 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:42.390+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:43.053 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:43.048+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:43.376 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:43.372+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:44.068 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:44.064+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:44.383 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:44.378+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:45.049 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:45.045+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:45.433 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:45.429+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:46.021 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:46.017+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:46.444 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:46.440+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:47.027 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:47.022+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:47.462 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:47.458+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:48.050 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:48.042+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:48.437 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:48.432+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:49.056 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:49.051+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:49.476 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:49.471+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:50.089 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:50.085+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:50.514 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:50.509+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:51.083 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:51.080+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:51.519 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:51.515+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:52.082 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:52.078+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:52.533 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:52.529+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:53.046 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:53.041+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:53.512 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:53.507+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:54.013 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:54.009+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:54.561 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:54.556+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:55.050 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:55.045+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:55.562 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:55.557+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:56.079 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:56.074+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:56.612 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:56.608+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:57.129 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:57.124+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:57.645 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:57.640+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:58.117 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:58.113+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:58.691 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:58.685+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T18:59:59.091 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T18:59:59.086+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T18:59:59.673 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T18:59:59.668+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:00.118 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:00.114+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:00.660 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:00.655+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:01.153 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:01.149+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:01.661 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:01.656+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:02.186 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:02.182+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:02.665 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:02.661+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:03.236 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:03.232+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:03.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:03.647+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:04.204 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:04.200+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:04.621 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:04.616+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:05.186 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:05.179+0000 1694c700 -1 osd.1 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:25.136227+0000 front 2019-11-27T18:59:23.871417+0000 (oldest deadline 2019-11-27T19:00:05.065076+0000) 2019-11-27T19:00:05.187 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:05.183+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:05.292 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:00:05.287+0000 1694c700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647209+0000 front 2019-11-27T18:59:23.842749+0000 (oldest deadline 2019-11-27T19:00:05.242229+0000) 2019-11-27T19:00:05.585 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:00:05.579+0000 1694c700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647420+0000 front 2019-11-27T18:59:24.851125+0000 (oldest deadline 2019-11-27T19:00:04.819190+0000) 2019-11-27T19:00:05.600 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:05.595+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:06.158 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:06.151+0000 1694c700 -1 osd.1 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:25.136227+0000 front 2019-11-27T18:59:23.871417+0000 (oldest deadline 2019-11-27T19:00:05.065076+0000) 2019-11-27T19:00:06.159 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:06.154+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:06.296 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:00:06.291+0000 1694c700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647209+0000 front 2019-11-27T18:59:23.842749+0000 (oldest deadline 2019-11-27T19:00:05.242229+0000) 2019-11-27T19:00:06.547 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:00:06.542+0000 1694c700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647420+0000 front 2019-11-27T18:59:24.851125+0000 (oldest deadline 2019-11-27T19:00:04.819190+0000) 2019-11-27T19:00:06.608 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:06.603+0000 1694c700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.646965+0000 front 2019-11-27T18:59:23.921526+0000 (oldest deadline 2019-11-27T19:00:06.350882+0000) 2019-11-27T19:00:06.611 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:06.607+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:07.183 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:07.177+0000 1694c700 -1 osd.1 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:25.136227+0000 front 2019-11-27T18:59:23.871417+0000 (oldest deadline 2019-11-27T19:00:05.065076+0000) 2019-11-27T19:00:07.183 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:07.179+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:07.258 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:00:07.253+0000 1694c700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647209+0000 front 2019-11-27T18:59:23.842749+0000 (oldest deadline 2019-11-27T19:00:05.242229+0000) 2019-11-27T19:00:07.574 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:07.569+0000 1694c700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.646965+0000 front 2019-11-27T18:59:23.921526+0000 (oldest deadline 2019-11-27T19:00:06.350882+0000) 2019-11-27T19:00:07.577 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:07.572+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:07.590 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:00:07.585+0000 1694c700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647420+0000 front 2019-11-27T18:59:24.851125+0000 (oldest deadline 2019-11-27T19:00:04.819190+0000) 2019-11-27T19:00:08.212 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:08.205+0000 1694c700 -1 osd.1 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:25.136227+0000 front 2019-11-27T18:59:23.871417+0000 (oldest deadline 2019-11-27T19:00:05.065076+0000) 2019-11-27T19:00:08.213 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:08.208+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:08.265 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:00:08.245+0000 1694c700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647209+0000 front 2019-11-27T18:59:23.842749+0000 (oldest deadline 2019-11-27T19:00:05.242229+0000) 2019-11-27T19:00:08.560 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:08.544+0000 1694c700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.646965+0000 front 2019-11-27T18:59:23.921526+0000 (oldest deadline 2019-11-27T19:00:06.350882+0000) 2019-11-27T19:00:08.568 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:08.556+0000 1694c700 -1 osd.7 144 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:08.629 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:00:08.618+0000 1694c700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647420+0000 front 2019-11-27T18:59:24.851125+0000 (oldest deadline 2019-11-27T19:00:04.819190+0000) 2019-11-27T19:00:08.694 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:00:08.689+0000 1694c700 -1 osd.3 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:23.071686+0000 front 2019-11-27T18:59:23.895260+0000 (oldest deadline 2019-11-27T19:00:08.099024+0000) 2019-11-27T19:00:08.927 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:00:08.922+0000 1694c700 -1 osd.5 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:23.075960+0000 front 2019-11-27T18:59:23.955722+0000 (oldest deadline 2019-11-27T19:00:08.747334+0000) 2019-11-27T19:00:09.174 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:09.170+0000 1694c700 -1 osd.1 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:25.136227+0000 front 2019-11-27T18:59:23.871417+0000 (oldest deadline 2019-11-27T19:00:05.065076+0000) 2019-11-27T19:00:09.174 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:00:09.171+0000 1694c700 -1 osd.1 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-27T19:00:09.283 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:00:09.278+0000 1694c700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T18:59:24.647209+0000 front 2019-11-27T18:59:23.842749+0000 (oldest deadline 2019-11-27T19:00:05.242229+0000) 2019-11-27T19:00:09.766 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:09.675+0000 1694c700 -1 osd.7 145 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:10.884 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:10.856+0000 1694c700 -1 osd.7 146 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:11.930 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:11.924+0000 1694c700 -1 osd.7 146 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:12.929 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:12.926+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:13.913 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:13.908+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:14.927 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:14.921+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:15.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:15.948+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:16.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:16.947+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:17.933 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:17.929+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:18.916 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:18.908+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:19.910 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:19.904+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:20.922 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:20.917+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:21.888 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:21.882+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:22.921 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:22.916+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:23.912 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:23.906+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:24.881 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:24.874+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:25.838 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:25.832+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:26.810 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:26.805+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:27.857 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:27.852+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:28.873 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:28.869+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:29.905 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:29.900+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:30.935 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:30.930+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:31.958 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:31.953+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:32.972 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:32.967+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:34.025 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:34.020+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:35.039 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:35.034+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:36.028 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:36.023+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:37.061 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:37.055+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:38.071 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:38.066+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:39.087 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:00:39.082+0000 1694c700 -1 osd.7 147 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:108721 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821091696 gen 47] snapc 0=[] ondisk+write+known_if_redirected e141) 2019-11-27T19:00:39.979 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:00:39.920+0000 20e22700 -1 RGWWatcher::handle_error cookie 821091696 err (107) Transport endpoint is not connected 2019-11-27T19:00:42.000 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:00:41.993+0000 37a78700 -1 osd.6 149 build_incremental_map_msg missing incremental map 149 2019-11-27T19:00:42.076 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:00:42.044+0000 34271700 -1 osd.6 149 build_incremental_map_msg missing incremental map 149 2019-11-27T19:01:47.962 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:01:47.957+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:05.560113+0000 front 2019-11-27T19:01:05.551814+0000 (oldest deadline 2019-11-27T19:01:47.832689+0000) 2019-11-27T19:01:48.857 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:01:48.851+0000 1694c700 -1 osd.3 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:05.468043+0000 front 2019-11-27T19:01:05.445402+0000 (oldest deadline 2019-11-27T19:01:48.795737+0000) 2019-11-27T19:01:48.917 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:01:48.912+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:05.560113+0000 front 2019-11-27T19:01:05.551814+0000 (oldest deadline 2019-11-27T19:01:47.832689+0000) 2019-11-27T19:01:49.309 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:01:49.304+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:04.148493+0000 front 2019-11-27T19:01:04.132254+0000 (oldest deadline 2019-11-27T19:01:48.776641+0000) 2019-11-27T19:01:49.314 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:01:49.308+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:03.383492+0000 front 2019-11-27T19:01:03.351784+0000 (oldest deadline 2019-11-27T19:01:48.644232+0000) 2019-11-27T19:01:49.901 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:01:49.896+0000 1694c700 -1 osd.3 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:05.468043+0000 front 2019-11-27T19:01:05.445402+0000 (oldest deadline 2019-11-27T19:01:48.795737+0000) 2019-11-27T19:01:49.913 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:01:49.907+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:05.560113+0000 front 2019-11-27T19:01:05.551814+0000 (oldest deadline 2019-11-27T19:01:47.832689+0000) 2019-11-27T19:01:50.308 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:01:50.301+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:03.383492+0000 front 2019-11-27T19:01:03.351784+0000 (oldest deadline 2019-11-27T19:01:48.644232+0000) 2019-11-27T19:01:50.334 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:01:50.329+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:04.148493+0000 front 2019-11-27T19:01:04.132254+0000 (oldest deadline 2019-11-27T19:01:48.776641+0000) 2019-11-27T19:01:50.876 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:01:50.870+0000 1694c700 -1 osd.3 150 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:01:05.468043+0000 front 2019-11-27T19:01:05.445402+0000 (oldest deadline 2019-11-27T19:01:48.795737+0000) 2019-11-27T19:02:35.165 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:08:09.227 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.169 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:08:09.231 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.181 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:08:09.190 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.187 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:08:09.197 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.189 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:08:09.251 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.195 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:08:09.257 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.428 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:08:09.490 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.438 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:08:09.447 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:35.441 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:08:09.503 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:02:53.740 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:02:53.735+0000 1694c700 -1 osd.7 153 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:02:54.782 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:02:54.778+0000 1694c700 -1 osd.7 153 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:02:55.748 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:02:55.744+0000 1694c700 -1 osd.7 153 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:02:56.717 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:02:56.713+0000 1694c700 -1 osd.7 153 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:02:57.952 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:02:57.942+0000 1694c700 -1 osd.7 154 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:02:58.959 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:02:58.955+0000 1694c700 -1 osd.7 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:00.006 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:00.001+0000 1694c700 -1 osd.7 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:01.058 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:01.051+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:02.074 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:02.070+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:03.059 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:03.054+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:04.057 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:04.053+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:05.101 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:05.097+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:06.117 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:06.107+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:07.081 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:07.078+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:08.103 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:08.099+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:09.153 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:09.148+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:10.194 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:10.190+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:11.167 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:11.163+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:12.181 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:12.177+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:13.171 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:13.167+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:14.163 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:14.159+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:15.136 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:15.132+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:16.136 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:16.131+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:17.095 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:17.091+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-11-27T19:03:18.057 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:18.046+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:19.047 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:19.043+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:20.062 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:20.058+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:21.040 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:21.035+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:22.094 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:22.089+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:22.821 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:08:56.883 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.857 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:08:56.919 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.865 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:08:56.927 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.881 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:08:56.891 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.882 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:08:56.892 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.883 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:08:56.941 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.951 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:08:56.960 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:22.971 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:08:57.033 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:23.075 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:23.071+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:23.083 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:08:57.145 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:24.119 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:24.114+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:25.147 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:25.141+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:26.134 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:26.130+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:27.117 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:27.113+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:27.676 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:27.672+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:28.155 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:28.150+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:28.719 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:28.714+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:29.124 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:29.118+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:29.741 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:29.735+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:30.089 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:30.084+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:30.738 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:30.734+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:31.117 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:31.110+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:31.395 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:31.389+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:31.787 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:31.783+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:31.794 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:31.789+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:32.086 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:32.081+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:32.429 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:32.424+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:32.435 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:32.430+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:32.841 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:32.835+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:32.841 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:32.837+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:33.077 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:33.072+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:33.388 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:33.383+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:33.443 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:33.434+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:33.677 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:33.672+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:33.857 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:33.852+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:33.858 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:33.853+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:33.902 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:33.898+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:34.107 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:34.100+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:34.108 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:34.103+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:34.407 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:34.402+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:34.422 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:34.415+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:34.662 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:34.657+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:34.908 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:34.854+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:34.918 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:34.912+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:34.934 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:34.855+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:35.117 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:35.111+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:35.118 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:35.113+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:35.305 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:35.300+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:35.428 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:35.422+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:35.457 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:35.447+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:35.691 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:35.686+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:35.863 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:35.847+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:35.864 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:35.859+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:35.878 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:35.868+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:36.103 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:36.097+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:36.104 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:36.099+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:36.273 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:36.267+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:36.460 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:36.452+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:36.505 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:36.500+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:36.664 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:36.657+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:36.835 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:36.831+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:36.918 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:36.907+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:36.922 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:36.908+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:37.158 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:37.151+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:37.160 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:37.155+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:37.324 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:37.321+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:37.499 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:37.493+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:37.565 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:37.559+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:37.619 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:37.614+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:37.835 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:37.829+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:37.880 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:37.873+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:37.880 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:37.875+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:38.186 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:38.179+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:38.187 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:38.182+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:38.378 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:38.374+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:38.491 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:38.485+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:38.595 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:38.590+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:38.617 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:38.611+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:38.841 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:38.837+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:39.123 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:39.116+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:39.124 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:39.120+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:39.148 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:39.144+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:39.151 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:39.147+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:39.421 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:39.417+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:39.519 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:39.514+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:39.556 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:39.551+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:39.625 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:39.620+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:39.828 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:39.824+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-11-27T19:03:40.119 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:40.115+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:40.120 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:40.116+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:40.181 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:40.176+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:40.185 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:40.179+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:40.387 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:40.381+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:40.516 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:40.510+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:40.548 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:40.541+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:40.619 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:40.614+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:40.820 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:40.814+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:41.166 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:41.162+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:41.169 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:41.165+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:41.189 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:41.183+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:41.192 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:41.187+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:41.355 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:41.349+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:41.507 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:41.502+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:41.534 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:41.528+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:41.628 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:41.623+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:41.863 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:41.857+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:42.169 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:42.165+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:42.172 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:42.168+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:42.182 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:42.176+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687390+0000 front 2019-11-27T19:02:53.761976+0000 (oldest deadline 2019-11-27T19:03:33.670418+0000) 2019-11-27T19:03:42.185 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:42.179+0000 1694c700 -1 osd.7 156 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:42.353 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:03:42.348+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:50.954463+0000 front 2019-11-27T19:02:50.379569+0000 (oldest deadline 2019-11-27T19:03:34.415616+0000) 2019-11-27T19:03:42.484 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:03:42.478+0000 1694c700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:54.687602+0000 front 2019-11-27T19:02:54.446562+0000 (oldest deadline 2019-11-27T19:03:31.662609+0000) 2019-11-27T19:03:42.532 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:03:42.526+0000 1694c700 -1 osd.5 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:46.339624+0000 front 2019-11-27T19:02:51.319518+0000 (oldest deadline 2019-11-27T19:03:31.268828+0000) 2019-11-27T19:03:42.627 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:42.621+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:42.875 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:03:42.869+0000 1694c700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.757067+0000 front 2019-11-27T19:02:53.751763+0000 (oldest deadline 2019-11-27T19:03:33.198849+0000) 2019-11-27T19:03:43.154 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:43.147+0000 1694c700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.830955+0000 front 2019-11-27T19:02:51.294335+0000 (oldest deadline 2019-11-27T19:03:30.838971+0000) 2019-11-27T19:03:43.154 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:03:43.149+0000 1694c700 -1 osd.1 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e154) 2019-11-27T19:03:43.284 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:43.280+0000 1694c700 -1 osd.7 157 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:43.581 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:03:43.576+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:02:53.766087+0000 front 2019-11-27T19:02:49.182730+0000 (oldest deadline 2019-11-27T19:03:33.526993+0000) 2019-11-27T19:03:44.279 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:44.275+0000 1694c700 -1 osd.7 157 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:45.276 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:45.271+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:46.233 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:46.227+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:47.209 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:47.204+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:48.211 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:48.206+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:49.196 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:49.191+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:50.175 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:50.169+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:51.166 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:51.162+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:52.146 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:52.141+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:53.191 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:53.186+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:54.164 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:54.160+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:55.186 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:55.182+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:56.181 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:56.176+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:57.194 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:57.189+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:58.244 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:58.238+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:03:59.286 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:03:59.281+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:00.256 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:04:00.251+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:01.224 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:04:01.218+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:02.213 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:04:02.208+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:03.169 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:04:03.164+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:04.166 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:04:04.161+0000 1694c700 -1 osd.7 158 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:05.363 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:04:05.340+0000 1694c700 -1 osd.7 159 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:109064 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413044768 gen 1] snapc 0=[] ondisk+write+known_if_redirected e153) 2019-11-27T19:04:05.668 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:04:05.660+0000 1694c700 -1 osd.4 158 get_health_metrics reporting 1 slow ops, oldest is osd_repop(osd.7.0:9016 5.5 e153/149 5:a93a5511:::notify.2:head v 153'146) 2019-11-27T19:04:05.765 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:04:05.751+0000 20e22700 -1 RGWWatcher::handle_error cookie 5413044768 err (107) Transport endpoint is not connected 2019-11-27T19:05:06.222 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:06.214+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:07.204 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:07.200+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:08.231 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:08.227+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:09.203 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:09.199+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:10.175 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:10.171+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:11.147 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:11.143+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:12.135 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:12.130+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:13.117 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:13.113+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:13.801 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:13.795+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:14.153 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:14.149+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:14.523 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:14.516+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:14.780 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:14.775+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:15.189 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:15.183+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:15.191 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:15.187+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:15.213 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:15.208+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:15.561 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:15.555+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:15.777 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:15.772+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:16.208 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:16.202+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:16.210 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:16.206+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:16.244 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:16.238+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:16.251 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:16.244+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:16.569 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:16.563+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:16.768 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:16.763+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:17.231 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:17.226+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:17.236 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:17.229+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:17.251 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:17.245+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:17.252 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:17.247+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:17.533 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:17.527+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:17.792 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:17.787+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:18.210 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:18.202+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:18.211 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:18.205+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:18.233 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:18.227+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:18.262 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:18.257+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:18.487 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:18.481+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:18.737 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:18.729+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:18.825 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:18.820+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:19.238 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:19.230+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:19.239 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:19.235+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:19.256 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:19.248+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:19.269 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:19.264+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:19.538 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:19.531+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:19.768 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:19.759+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:19.849 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:19.842+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:20.246 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:20.239+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:20.249 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:20.244+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:20.250 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:20.246+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:20.290 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:20.285+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:20.513 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:20.506+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:20.745 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:20.737+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:20.806 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:20.800+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:21.291 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:21.283+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:21.298 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:21.291+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:21.299 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:21.294+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:21.323 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:21.317+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:21.488 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:21.481+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:21.761 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:21.756+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:21.795 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:21.788+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:22.286 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:22.280+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:22.293 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:22.282+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:22.301 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:22.295+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:22.310 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:22.304+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:22.470 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:22.465+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:22.753 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:22.749+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:22.830 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:22.824+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:23.271 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:23.267+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:23.273 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:23.269+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:23.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:23.279+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:23.298 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:23.291+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:23.482 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:23.476+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:23.797 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:23.792+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:23.808 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:23.802+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:24.259 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:24.254+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:24.261 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:24.256+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:24.270 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:24.264+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:24.339 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:24.333+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:24.460 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:24.453+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:24.783 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:24.776+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:24.790 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:24.783+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:25.221 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:25.215+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:25.223 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:25.217+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:25.323 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:25.317+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:25.364 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:25.358+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:25.498 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:25.492+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:25.757 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:25.751+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:25.810 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:25.804+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:26.215 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:26.211+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:26.217 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:26.214+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:26.295 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:26.289+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:26.358 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:26.351+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:26.470 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:26.463+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:26.740 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:26.734+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:26.814 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:26.809+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:27.181 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:27.176+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:27.182 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:27.179+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:27.262 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:27.257+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:27.314 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:27.309+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:27.481 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:27.475+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:27.718 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:05:27.712+0000 1694c700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.640108+0000 front 2019-11-27T19:04:33.361270+0000 (oldest deadline 2019-11-27T19:05:18.149084+0000) 2019-11-27T19:05:27.811 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:05:27.805+0000 1694c700 -1 osd.2 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:33.637260+0000 front 2019-11-27T19:04:33.079833+0000 (oldest deadline 2019-11-27T19:05:13.785131+0000) 2019-11-27T19:05:28.185 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:28.178+0000 1694c700 -1 osd.0 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.918506+0000 front 2019-11-27T19:04:29.848538+0000 (oldest deadline 2019-11-27T19:05:14.958116+0000) 2019-11-27T19:05:28.185 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:28.181+0000 1694c700 -1 osd.0 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:28.266 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:05:28.260+0000 1694c700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:30.299810+0000 front 2019-11-27T19:04:30.542789+0000 (oldest deadline 2019-11-27T19:05:15.425511+0000) 2019-11-27T19:05:28.317 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:05:28.310+0000 1694c700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:29.875193+0000 front 2019-11-27T19:04:29.881903+0000 (oldest deadline 2019-11-27T19:05:14.487914+0000) 2019-11-27T19:05:28.495 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:05:28.489+0000 1694c700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:04:28.376571+0000 front 2019-11-27T19:04:28.327769+0000 (oldest deadline 2019-11-27T19:05:14.164469+0000) 2019-11-27T19:05:29.320 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:29.294+0000 1694c700 -1 osd.0 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:30.464 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:30.459+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:31.448 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:31.443+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:32.491 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:32.486+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:33.521 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:33.516+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:34.482 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:34.476+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:35.488 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:35.483+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:36.508 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:36.504+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:37.461 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:37.457+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:38.455 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:38.452+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:38.821 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:11:12.883 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.136 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:11:12.937 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.136 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:11:12.945 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.137 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:11:13.219 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.137 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:11:12.895 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.137 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:11:13.231 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.137 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:11:12.937 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.137 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:11:12.938 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.137 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:11:13.116 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:05:43.138 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:39.452+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:43.138 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:40.500+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:43.138 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:41.476+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:43.138 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:42.499+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:43.554 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:43.550+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:44.533 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:44.529+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:45.543 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:45.538+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:46.509 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:46.505+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:48.046 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:47.539+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:48.511 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:48.507+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:49.555 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:49.551+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:50.573 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:50.559+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:51.607 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:51.602+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:52.589 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:52.581+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:53.577 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:53.573+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:54.550 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:54.546+0000 1694c700 -1 osd.0 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:05:55.592 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:05:55.575+0000 1694c700 -1 osd.0 164 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109377 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e161) 2019-11-27T19:06:20.099 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:11:54.160 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.112 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:11:54.174 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.113 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:11:54.175 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.116 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:11:54.126 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.120 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:11:54.130 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.122 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:11:54.184 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.177 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:11:54.239 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.184 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:11:54.246 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:20.201 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:11:54.206 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:06:25.595 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:25.590+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:26.559 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:26.554+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:26.807 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:26.803+0000 1694c700 -1 osd.3 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:27.589 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:27.584+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:27.767 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:27.762+0000 1694c700 -1 osd.3 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:28.010 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:06:28.005+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.848904+0000 front 2019-11-27T19:05:44.845343+0000 (oldest deadline 2019-11-27T19:06:27.169717+0000) 2019-11-27T19:06:28.531 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:06:28.526+0000 1694c700 -1 osd.0 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.240429+0000 front 2019-11-27T19:05:44.692960+0000 (oldest deadline 2019-11-27T19:06:27.800575+0000) 2019-11-27T19:06:28.592 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:28.586+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:28.740 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:28.735+0000 1694c700 -1 osd.3 164 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:28.771 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:06:28.731+0000 11cac700 -1 osd.0 165 build_incremental_map_msg missing incremental map 165 2019-11-27T19:06:29.025 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:06:29.021+0000 1694c700 -1 osd.5 165 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.848904+0000 front 2019-11-27T19:05:44.845343+0000 (oldest deadline 2019-11-27T19:06:27.169717+0000) 2019-11-27T19:06:29.529 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:06:29.525+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.240429+0000 front 2019-11-27T19:05:44.692960+0000 (oldest deadline 2019-11-27T19:06:27.800575+0000) 2019-11-27T19:06:29.563 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:29.559+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:29.671 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:06:29.665+0000 39a7c700 -1 osd.2 166 build_incremental_map_msg missing incremental map 165 2019-11-27T19:06:29.825 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:29.764+0000 1694c700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:30.038 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:06:30.034+0000 1694c700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.848904+0000 front 2019-11-27T19:05:44.845343+0000 (oldest deadline 2019-11-27T19:06:27.169717+0000) 2019-11-27T19:06:30.144 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:06:30.139+0000 1694c700 -1 osd.2 166 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:46.857519+0000 front 2019-11-27T19:05:46.549877+0000 (oldest deadline 2019-11-27T19:06:30.031474+0000) 2019-11-27T19:06:30.305 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:30.296+0000 3b27f700 -1 osd.3 166 build_incremental_map_msg missing incremental map 165 2019-11-27T19:06:30.536 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:06:30.531+0000 1694c700 -1 osd.0 166 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.240429+0000 front 2019-11-27T19:05:44.692960+0000 (oldest deadline 2019-11-27T19:06:27.800575+0000) 2019-11-27T19:06:30.538 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:30.533+0000 1694c700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:30.920 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:30.912+0000 1694c700 -1 osd.3 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:31.013 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:06:31.002+0000 1694c700 -1 osd.6 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.191659+0000 front 2019-11-27T19:05:45.230616+0000 (oldest deadline 2019-11-27T19:06:30.108965+0000) 2019-11-27T19:06:31.186 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:06:31.179+0000 1694c700 -1 osd.5 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.848904+0000 front 2019-11-27T19:05:44.845343+0000 (oldest deadline 2019-11-27T19:06:27.169717+0000) 2019-11-27T19:06:31.263 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:06:31.257+0000 1694c700 -1 osd.2 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:46.857519+0000 front 2019-11-27T19:05:46.549877+0000 (oldest deadline 2019-11-27T19:06:30.031474+0000) 2019-11-27T19:06:31.532 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:06:31.527+0000 1694c700 -1 osd.0 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.240429+0000 front 2019-11-27T19:05:44.692960+0000 (oldest deadline 2019-11-27T19:06:27.800575+0000) 2019-11-27T19:06:31.579 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:31.575+0000 1694c700 -1 osd.7 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:31.949 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:31.945+0000 1694c700 -1 osd.3 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:32.034 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:06:32.029+0000 1694c700 -1 osd.6 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.191659+0000 front 2019-11-27T19:05:45.230616+0000 (oldest deadline 2019-11-27T19:06:30.108965+0000) 2019-11-27T19:06:32.178 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:06:32.171+0000 1694c700 -1 osd.5 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.848904+0000 front 2019-11-27T19:05:44.845343+0000 (oldest deadline 2019-11-27T19:06:27.169717+0000) 2019-11-27T19:06:32.248 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:06:32.242+0000 1694c700 -1 osd.2 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:46.857519+0000 front 2019-11-27T19:05:46.549877+0000 (oldest deadline 2019-11-27T19:06:30.031474+0000) 2019-11-27T19:06:32.560 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:06:32.552+0000 1694c700 -1 osd.0 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:45.240429+0000 front 2019-11-27T19:05:44.692960+0000 (oldest deadline 2019-11-27T19:06:27.800575+0000) 2019-11-27T19:06:32.617 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:32.613+0000 1694c700 -1 osd.7 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:44.697448+0000 front 2019-11-27T19:05:44.778330+0000 (oldest deadline 2019-11-27T19:06:25.505691+0000) 2019-11-27T19:06:32.998 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:06:32.970+0000 1694c700 -1 osd.3 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.771487+0000 front 2019-11-27T19:05:40.272988+0000 (oldest deadline 2019-11-27T19:06:26.152386+0000) 2019-11-27T19:06:33.168 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:06:33.163+0000 1694c700 -1 osd.5 167 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:05:43.848904+0000 front 2019-11-27T19:05:44.845343+0000 (oldest deadline 2019-11-27T19:06:27.169717+0000) 2019-11-27T19:06:34.737 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:34.671+0000 1694c700 -1 osd.7 169 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:35.695 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:35.690+0000 1694c700 -1 osd.7 169 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:36.734 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:36.728+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:37.734 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:37.730+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:38.709 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:38.704+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:39.733 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:39.728+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:40.697 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:40.693+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:41.675 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:41.671+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:42.724 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:42.716+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:43.697 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:43.688+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:44.653 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:44.648+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:45.625 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:45.621+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:46.627 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:46.623+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:47.669 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:47.665+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:48.719 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:48.715+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:49.745 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:49.741+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:50.763 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:50.756+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:51.813 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:51.808+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:52.863 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:52.859+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:53.878 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:53.874+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:54.929 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:54.924+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:55.966 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:55.962+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:56.965 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:56.959+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:57.273 INFO:teuthology.orchestra.run.smithi005.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-11-27T19:06:58.002 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:57.996+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:58.962 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:58.955+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:06:59.917 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:06:59.912+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:07:00.909 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:07:00.904+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:07:01.905 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:07:01.901+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:07:02.868 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:07:02.863+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:07:03.895 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:07:03.890+0000 1694c700 -1 osd.7 170 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:07:05.132 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:07:04.979+0000 1694c700 -1 osd.7 171 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109530 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1472158528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e164) 2019-11-27T19:07:05.426 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:07:05.422+0000 20e22700 -1 RGWWatcher::handle_error cookie 1472158528 err (107) Transport endpoint is not connected 2019-11-27T19:07:45.129 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:07:45.109+0000 114ab700 -1 osd.0 172 build_incremental_map_msg missing incremental map 172 2019-11-27T19:07:46.742 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:07:46.734+0000 35273700 -1 osd.4 173 build_incremental_map_msg missing incremental map 173 2019-11-27T19:07:47.005 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:07:46.903+0000 37a78700 -1 osd.4 173 build_incremental_map_msg missing incremental map 173 2019-11-27T19:07:47.246 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:07:47.001+0000 35a74700 -1 osd.4 173 build_incremental_map_msg missing incremental map 173 2019-11-27T19:07:47.459 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:07:47.051+0000 38a7a700 -1 osd.4 173 build_incremental_map_msg missing incremental map 173 2019-11-27T19:07:48.230 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:07:47.995+0000 3aa7e700 -1 osd.4 173 build_incremental_map_msg missing incremental map 173 2019-11-27T19:07:53.507 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:07:53.490+0000 33a70700 -1 osd.4 173 build_incremental_map_msg missing incremental map 173 2019-11-27T19:08:49.290 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:49.278+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:50.265 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:50.260+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:50.687 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:50.682+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:50.708 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:50.702+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:51.282 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:51.277+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:51.502 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:51.495+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:51.644 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:51.639+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:51.763 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:51.756+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:52.278 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:52.272+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:52.500 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:52.495+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:52.601 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:52.595+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:52.818 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:52.808+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:53.216 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:53.211+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:53.254 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:53.249+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:53.558 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:53.551+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:53.630 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:53.624+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:53.868 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:53.860+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:53.929 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:53.922+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:54.210 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:54.203+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:54.229 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:54.225+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:54.522 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:54.517+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:54.662 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:54.656+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:54.898 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:54.892+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:54.960 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:54.953+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:55.244 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:55.238+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:55.250 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:55.243+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:55.522 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:55.513+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:55.680 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:55.673+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:55.866 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:55.860+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:55.943 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:55.936+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:56.239 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:56.233+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:56.279 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:56.273+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:56.527 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:56.521+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:56.703 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:56.698+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:56.908 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:56.902+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:56.942 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:56.936+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:57.207 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:57.201+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:57.266 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:57.261+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:57.497 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:57.492+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:57.657 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:57.652+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:57.940 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:57.934+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:57.959 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:57.953+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:58.230 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:58.224+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:58.312 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:58.307+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:58.505 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:58.499+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:58.648 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:58.642+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:58.916 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:58.910+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:08:58.921 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:58.915+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:59.046 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:08:59.039+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:08:59.221 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:08:59.215+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:08:59.330 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:08:59.325+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:08:59.538 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:08:59.532+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:08:59.619 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:08:59.614+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:08:59.879 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:08:59.873+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:08:59.906 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:08:59.900+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:00.100 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:00.093+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:00.195 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:00.188+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:00.303 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:00.297+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:00.534 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:00.527+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:00.659 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:00.653+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:00.891 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:00.884+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:00.916 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:00.910+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:01.081 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:01.075+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:01.219 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:01.214+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:01.324 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:01.317+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:01.552 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:01.546+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:01.614 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:01.608+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:01.849 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:01.843+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:01.904 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:01.897+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:02.055 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:02.048+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:02.202 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:02.196+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:02.307 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:02.302+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:02.573 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:02.566+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:02.658 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:02.652+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:02.817 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:02.810+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:02.951 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:02.945+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:03.014 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:03.008+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:03.180 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:03.171+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:03.331 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:03.326+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:03.582 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:03.576+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:03.676 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:03.671+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:03.815 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:03.809+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:03.978 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:03.972+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:04.034 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:04.029+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:04.207 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:04.201+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:04.385 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:04.379+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:04.551 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:04.545+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:04.725 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:04.715+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:04.835 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:04.829+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:04.976 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:04.970+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:05.074 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:05.068+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:05.250 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:05.245+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:05.377 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:05.372+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:05.600 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:05.594+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:05.685 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:05.679+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:05.886 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:05.879+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:06.006 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:05.999+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:06.098 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:06.092+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:06.235 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:06.230+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:06.382 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:06.376+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:06.617 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:06.611+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:06.740 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:06.733+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:06.901 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:06.895+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:07.040 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:07.035+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:07.138 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:07.132+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:07.207 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:07.199+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:07.392 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:07.387+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:07.649 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:07.643+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:07.766 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:07.761+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:07.938 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:07.932+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:08.088 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:08.081+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:08.156 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:08.150+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:08.237 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:08.229+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:08.438 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:08.433+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:08.643 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:08.636+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:08.731 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:08.725+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:08.966 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:08.960+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:09.096 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:09.089+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:09.178 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:09.171+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:09.196 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:09.189+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:09.467 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:09.459+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:09.644 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:09.638+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:09.694 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:09.688+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:09.988 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:09.982+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:10.071 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:10.065+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:10.176 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:10.171+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:10.205 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:10.199+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:10.454 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:10.448+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:10.645 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:10.639+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:10.686 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:10.677+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:11.014 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:11.007+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:11.097 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:11.091+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:11.141 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:11.134+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:11.207 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:11.201+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:11.419 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:11.414+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:11.650 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:11.644+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:11.657 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:11.651+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:12.035 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:12.029+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:12.083 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:12.076+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:12.170 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:12.164+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:12.180 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:12.174+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:12.446 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:12.440+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:12.650 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:12.644+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:12.674 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:12.668+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:13.014 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:13.008+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:13.106 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:13.100+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:13.179 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:13.173+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:13.201 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:13.196+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:13.462 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:13.457+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:13.649 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:09:13.643+0000 1694c700 -1 osd.7 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:08.071382+0000 front 2019-11-27T19:08:07.897863+0000 (oldest deadline 2019-11-27T19:08:50.977543+0000) 2019-11-27T19:09:13.682 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:13.677+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:13.976 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:09:13.970+0000 1694c700 -1 osd.4 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.366168+0000 front 2019-11-27T19:08:07.501439+0000 (oldest deadline 2019-11-27T19:08:50.117323+0000) 2019-11-27T19:09:14.085 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:14.078+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:14.151 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:09:14.144+0000 1694c700 -1 osd.6 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.132761+0000 front 2019-11-27T19:08:07.139210+0000 (oldest deadline 2019-11-27T19:08:52.992152+0000) 2019-11-27T19:09:14.226 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:09:14.220+0000 1694c700 -1 osd.0 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.797072+0000 front 2019-11-27T19:08:07.960049+0000 (oldest deadline 2019-11-27T19:08:58.870911+0000) 2019-11-27T19:09:14.450 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:09:14.445+0000 1694c700 -1 osd.3 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.254247+0000 front 2019-11-27T19:08:07.276937+0000 (oldest deadline 2019-11-27T19:08:48.283547+0000) 2019-11-27T19:09:14.650 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:09:14.645+0000 1694c700 -1 osd.2 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:05.198140+0000 front 2019-11-27T19:08:05.687674+0000 (oldest deadline 2019-11-27T19:08:49.880713+0000) 2019-11-27T19:09:15.049 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:09:15.044+0000 1694c700 -1 osd.5 173 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:08:07.634231+0000 front 2019-11-27T19:08:08.083771+0000 (oldest deadline 2019-11-27T19:08:52.904346+0000) 2019-11-27T19:09:19.234 INFO:teuthology.orchestra.run.smithi005.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-11-27T19:09:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-11-27T19:10:03.197 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:03.189+0000 124ad700 -1 osd.7 177 build_incremental_map_msg missing incremental map 177 2019-11-27T19:10:03.209 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:03.190+0000 114ab700 -1 osd.2 177 build_incremental_map_msg missing incremental map 177 2019-11-27T19:10:03.413 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:03.404+0000 124ad700 -1 osd.2 177 build_incremental_map_msg missing incremental map 177 2019-11-27T19:10:03.619 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:03.601+0000 11cac700 -1 osd.7 177 build_incremental_map_msg missing incremental map 177 2019-11-27T19:10:03.836 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:03.831+0000 114ab700 -1 osd.5 177 build_incremental_map_msg missing incremental map 177 2019-11-27T19:10:04.573 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:04.567+0000 114ab700 -1 osd.2 178 build_incremental_map_msg missing incremental map 177 2019-11-27T19:10:08.197 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:15:42.258 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.208 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:15:42.270 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.215 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:15:42.277 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.219 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:15:42.281 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.224 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:15:42.233 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.234 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:15:42.243 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.522 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:15:42.532 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.575 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:15:42.636 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.577 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:15:42.639 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:10.003 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:09.999+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:10.670 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:10.662+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:11.002 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:10.998+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:11.695 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:11.691+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:11.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:11.985+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:12.030 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:12.025+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:12.684 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:12.674+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:12.968 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:12.961+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:12.995 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:12.990+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:13.642 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:13.636+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:13.882 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:13.876+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:13.976 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:13.972+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:14.017 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:14.012+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:14.020 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:14.015+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:14.625 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:14.619+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:14.855 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:14.850+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:14.963 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:14.956+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:15.065 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:15.060+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:15.068 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:15.063+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:15.616 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:15.601+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:15.617 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:15.610+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:15.861 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:15.855+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:15.980 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:15.974+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:16.062 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:16.055+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:16.079 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:16.073+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:16.081 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:16.077+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:16.598 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:16.593+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:16.600 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:16.597+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:16.882 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:16.875+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:16.986 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:16.981+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:17.089 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:17.083+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:17.090 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:17.085+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:17.096 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:17.090+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:17.617 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:17.607+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:17.617 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:17.609+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:17.929 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:17.923+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:18.036 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:18.032+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:18.063 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:18.058+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:18.066 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:18.058+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:18.066 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:18.061+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:18.578 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:18.572+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:18.579 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:18.574+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:18.894 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:18.889+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:19.027 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:19.021+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:19.085 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:19.079+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:19.085 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:19.081+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:19.117 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:19.112+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:19.547 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:19.541+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:19.549 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:19.544+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:19.882 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:19.876+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:20.054 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:20.047+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:20.129 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:20.125+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:20.131 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:20.127+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:20.146 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:20.134+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:20.532 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:20.525+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:20.532 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:20.527+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:20.840 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:20.833+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:21.097 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:21.091+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:21.147 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:21.142+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:21.150 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:21.146+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:21.166 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:21.160+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:21.552 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:21.545+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:21.554 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:21.549+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:21.835 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:21.826+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:22.146 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:22.140+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:22.166 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:22.159+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:22.166 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:22.161+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:22.167 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:22.162+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:22.539 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:22.532+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:22.540 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:22.534+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:22.837 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:22.826+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:23.114 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:23.109+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:23.176 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:23.172+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:23.179 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:23.175+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:23.207 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:23.202+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:23.501 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:23.493+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:23.501 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:23.496+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:23.888 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:23.880+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:24.127 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:24.120+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:24.136 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:24.131+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:24.139 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:24.135+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:24.234 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:24.229+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:24.541 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:24.535+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:24.541 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:24.537+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:24.876 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:24.870+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:25.120 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:25.114+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:25.182 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:25.176+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:25.183 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:25.178+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:25.243 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:25.239+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:25.534 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:25.528+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:25.537 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:25.533+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:25.880 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:25.875+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:26.131 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:26.125+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:26.146 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:26.141+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:26.149 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:26.145+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:26.246 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:26.241+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:26.515 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:26.508+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:26.516 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:26.510+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:26.846 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:26.840+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:27.010 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:27.001+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:27.109 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:27.103+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:27.109 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:27.105+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:27.171 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:27.166+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:27.218 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:27.213+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:27.488 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:27.483+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:27.491 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:27.486+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:27.853 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:27.840+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:28.003 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:27.995+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:28.120 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:28.114+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:28.121 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:28.116+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:28.153 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:28.148+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:28.198 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:28.192+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:28.461 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:28.455+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:28.461 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:28.457+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:28.830 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:28.825+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:28.998 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:28.993+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:29.136 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:29.131+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:29.139 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:29.135+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:29.200 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:29.195+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:29.201 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:29.195+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:29.514 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:29.509+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:29.517 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:29.513+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:29.785 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:29.779+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:30.039 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:30.034+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:30.097 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:30.091+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:30.098 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:30.093+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:30.176 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:30.170+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:30.211 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:30.205+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:30.564 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:30.557+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:30.565 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:30.561+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:30.803 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:30.798+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:31.051 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:31.046+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:31.093 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:31.087+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:31.094 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:31.089+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:31.165 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:31.158+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:31.185 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:31.179+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:31.262 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:31.258+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:31.554 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:31.549+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:31.554 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:31.550+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:31.859 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:31.851+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:32.072 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:32.067+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:32.086 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:32.080+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:32.087 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:32.082+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:32.178 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:32.173+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:32.214 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:32.207+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:32.257 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:32.251+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:32.548 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:32.543+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:32.548 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:32.544+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:32.847 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:32.843+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:33.048 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:33.043+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:33.090 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:33.085+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:33.090 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:33.086+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:33.184 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:33.178+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:33.244 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:33.238+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:33.252 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:33.247+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:33.502 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:33.498+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:33.504 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:33.501+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:33.843 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:33.837+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:34.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:34.015+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:34.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:34.019+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:34.101 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:34.094+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:34.102 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:34.097+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:34.230 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:34.224+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:34.231 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:34.226+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:34.298 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:34.293+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:34.534 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:34.528+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:34.535 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:34.530+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:34.836 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:34.830+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:35.014 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:35.009+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:35.020 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:35.015+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:35.074 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:35.069+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:35.075 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:35.070+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:35.198 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:35.193+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:35.213 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:35.207+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:35.277 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:35.272+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:35.573 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:35.568+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:35.576 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:35.572+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:35.808 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:35.800+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:36.011 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:36.006+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:36.013 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:36.008+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:36.067 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:36.061+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:36.068 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:36.063+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:36.191 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:36.185+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:36.199 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:36.193+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:36.252 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:36.246+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:36.617 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:36.612+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:36.618 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:36.614+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:36.809 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:36.804+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:37.046 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:37.037+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:37.047 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:37.039+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:37.068 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:37.064+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:37.075 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:37.066+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:37.156 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:37.150+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:37.196 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:37.190+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:37.301 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:37.295+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:37.633 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:37.627+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:37.634 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:37.629+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:37.771 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:37.765+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:38.001 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:37.996+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:38.005 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:38.000+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:38.065 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:38.058+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:38.067 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:38.061+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:38.131 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:38.125+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:38.171 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:38.166+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:38.276 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:38.270+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:38.654 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:38.648+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:38.654 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:38.650+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:38.780 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:38.775+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:39.043 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:39.038+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:39.048 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:39.043+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:39.067 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:39.062+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:39.073 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:39.066+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:39.108 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:39.103+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:39.161 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:39.156+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:39.320 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:39.314+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:39.688 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:39.684+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:39.690 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:39.686+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:39.797 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:39.792+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:40.051 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:40.043+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:40.052 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:40.047+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:40.119 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:40.113+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:40.120 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:40.114+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:40.120 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:40.116+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:40.216 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:40.210+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:40.351 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:40.346+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:40.687 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:40.680+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:40.687 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:40.683+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:40.769 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:40.764+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:41.094 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:41.088+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:41.095 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:41.090+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:41.097 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:41.092+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:41.147 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:41.141+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:41.151 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:41.146+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:41.174 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:41.168+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:41.346 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:41.341+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:41.727 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:41.720+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:41.727 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:41.723+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:41.797 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:41.791+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:42.060 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:42.054+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:42.075 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:42.066+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:42.077 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:42.071+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:42.170 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:42.162+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:42.177 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:42.169+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:42.223 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:42.218+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:42.300 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:42.295+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:42.706 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:42.702+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:42.708 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:42.704+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:42.811 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:42.806+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:43.058 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:43.053+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:43.062 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:43.057+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:43.089 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:43.084+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:43.183 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:43.178+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:43.184 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:43.179+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:43.185 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:43.179+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:43.267 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:43.261+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:43.727 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:43.722+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:43.730 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:43.726+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:43.826 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:43.820+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:44.018 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:44.013+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:44.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:44.017+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:44.092 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:44.086+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:44.167 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:44.160+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:44.168 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:44.163+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:44.223 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:44.218+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:44.264 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:44.259+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:44.780 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:44.774+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:44.783 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:44.779+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:44.789 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:44.782+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:44.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:10:44.877+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 43sec e180 v180) 2019-11-27T19:10:45.006 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:45.001+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:45.007 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:45.002+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:45.070 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:45.066+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:45.160 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:45.156+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:45.164 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:45.159+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:45.236 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:45.232+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:45.240 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:45.235+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:45.744 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:45.739+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:45.799 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:45.794+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:45.805 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:45.797+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:45.963 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:45.957+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:45.964 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:45.960+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:46.066 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:46.060+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:46.166 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:46.161+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:46.168 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:46.164+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:46.237 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:46.231+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:46.287 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:46.283+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:46.703 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:46.697+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:46.783 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:46.777+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:46.784 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:46.779+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:47.015 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:47.009+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:47.017 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:47.011+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:47.031 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:47.025+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:47.133 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:47.129+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:47.137 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:47.132+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:47.193 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:47.188+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:47.296 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:47.291+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:47.725 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:47.719+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:47.777 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:47.772+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:47.781 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:47.776+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:47.997 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:47.991+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:48.002 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:47.997+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:48.005 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:47.999+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:48.101 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:48.095+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:48.102 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:48.097+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:48.151 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:48.146+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:48.270 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:48.265+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:48.750 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:48.745+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:48.814 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:48.808+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:48.814 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:48.810+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:48.991 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:48.984+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:48.992 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:48.987+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:49.002 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:48.997+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:49.084 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:49.079+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:49.099 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:49.095+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:49.177 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:49.171+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:49.229 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:49.224+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:49.747 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:49.741+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:49.802 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:49.797+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:49.805 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:49.801+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:49.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:10:49.901+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 43sec e180 v180) 2019-11-27T19:10:49.963 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:49.957+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:49.966 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:49.962+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:50.029 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:50.022+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:50.068 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:50.062+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:50.070 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:50.064+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:50.208 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:50.203+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:50.216 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:50.211+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:50.801 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:50.795+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:50.833 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:50.828+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:50.835 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:50.832+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:51.016 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:51.008+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:51.018 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:51.012+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:51.051 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:51.044+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:51.115 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:51.109+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:51.119 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:51.114+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:51.222 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:51.216+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:51.245 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:51.240+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:51.809 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:51.794+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:51.809 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:51.795+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:51.832 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:51.827+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:51.987 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:51.981+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:51.990 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:51.984+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:52.017 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:52.012+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:52.125 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:52.113+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:52.125 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:52.116+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:52.230 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:52.225+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:52.231 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:52.227+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:52.787 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:52.782+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:52.824 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:52.819+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:52.825 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:52.820+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:52.977 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:52.968+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:52.977 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:52.971+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:53.057 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:53.052+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:53.165 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:53.159+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:53.166 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:53.161+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:53.248 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:53.243+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:53.274 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:53.269+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:53.820 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:53.814+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:53.860 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:53.854+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:53.861 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:53.856+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:53.992 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:53.988+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:54.004 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:53.991+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:54.086 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:54.080+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:54.174 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:54.169+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:25.895083+0000 front 2019-11-27T19:09:31.795649+0000 (oldest deadline 2019-11-27T19:10:09.729681+0000) 2019-11-27T19:10:54.178 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:54.173+0000 1694c700 -1 osd.7 180 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:54.209 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:54.204+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:54.255 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:10:54.249+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:29.176634+0000 front 2019-11-27T19:09:28.115593+0000 (oldest deadline 2019-11-27T19:10:30.594991+0000) 2019-11-27T19:10:54.856 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:10:54.850+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.805023+0000 front 2019-11-27T19:09:31.806715+0000 (oldest deadline 2019-11-27T19:10:13.812243+0000) 2019-11-27T19:10:54.907 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:54.902+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:27.130842+0000 front 2019-11-27T19:09:31.836329+0000 (oldest deadline 2019-11-27T19:10:09.844973+0000) 2019-11-27T19:10:54.912 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:54.908+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:54.984 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:10:54.975+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 43sec e180 v180) 2019-11-27T19:10:55.041 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:55.034+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:09:46.220018+0000 (oldest deadline 2019-11-27T19:10:26.220018+0000) 2019-11-27T19:10:55.041 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:10:55.037+0000 1694c700 -1 osd.1 180 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e177) 2019-11-27T19:10:55.088 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:10:55.081+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:31.088311+0000 front 2019-11-27T19:09:27.325599+0000 (oldest deadline 2019-11-27T19:10:11.055924+0000) 2019-11-27T19:10:55.201 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:10:55.197+0000 1694c700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:09:33.705652+0000 front 2019-11-27T19:09:30.042221+0000 (oldest deadline 2019-11-27T19:10:15.596537+0000) 2019-11-27T19:10:55.286 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:55.220+0000 1694c700 -1 osd.7 181 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:55.886 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:55.881+0000 1694c700 -1 osd.3 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:56.210 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:56.206+0000 1694c700 -1 osd.7 181 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:57.009 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:56.925+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:57.216 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:57.209+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:58.174 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:58.170+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:58.213 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:58.207+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:10:59.169 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:10:59.165+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:10:59.206 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:10:59.201+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:00.146 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:00.142+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:00.233 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:00.228+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:01.148 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:01.144+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:01.249 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:01.244+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:02.184 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:02.180+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:02.281 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:02.276+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:03.232 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:03.228+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:03.289 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:03.283+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:04.265 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:04.259+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:04.266 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:04.261+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:05.220 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:05.216+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:05.310 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:05.304+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:06.209 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:06.204+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:06.270 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:06.264+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:07.250 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:07.245+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:07.260 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:07.254+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:08.279 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:08.274+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:08.315 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:08.307+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:09.293 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:09.289+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:09.354 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:09.348+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:10.321 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:10.315+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:10.342 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:10.336+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:11.319 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:11.314+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:11.325 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:11.320+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:12.332 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:12.328+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:12.355 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:12.350+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:13.319 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:13.315+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:13.381 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:13.376+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:14.350 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:14.346+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:14.423 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:14.418+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:15.360 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:15.355+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:15.461 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:15.456+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:16.356 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:11:16.352+0000 1694c700 -1 osd.3 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:109999 6.2 6:4461ab83:root::.bucket.meta.17a7daed88f84431bc325984e7987658%3adc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.654:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e176) 2019-11-27T19:11:16.438 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:16.433+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:17.405 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:17.399+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:18.372 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:18.367+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:19.363 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:19.358+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:20.409 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:20.404+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:21.424 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:21.418+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:22.483 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:22.473+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:23.443 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:23.434+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:24.462 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:24.457+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:25.474 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:25.465+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:26.453 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:26.447+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:27.410 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:11:27.370+0000 28259700 -1 reset not still connected to 0x10100960 2019-11-27T19:11:27.452 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:11:27.446+0000 1694c700 -1 osd.7 182 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:109996 5.5 5:a93a5511:::notify.2:head [watch ping cookie 364243216 gen 1] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-11-27T19:11:27.505 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:11:27.371+0000 28259700 -1 reset not still connected to 0x3bb637c0 2019-11-27T19:11:28.336 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:11:28.310+0000 20e22700 -1 RGWWatcher::handle_error cookie 364243216 err (107) Transport endpoint is not connected 2019-11-27T19:11:30.039 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:11:30.025+0000 114ab700 -1 osd.5 184 build_incremental_map_msg missing incremental map 184 2019-11-27T19:11:30.107 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:11:30.049+0000 124ad700 -1 osd.0 184 build_incremental_map_msg missing incremental map 184 2019-11-27T19:11:45.381 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:17:19.443 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.385 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:17:19.446 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.400 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:17:19.409 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.445 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:17:19.454 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.463 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:17:19.524 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.467 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:17:19.528 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.609 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:17:19.669 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.630 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:17:19.638 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:45.646 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:17:19.707 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:12:01.154 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:01.149+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110213 6.b 6:df7b5d27:root::17a7daed88f84431bc325984e7987658:head [call version.read in=11b,getxattrs,stat] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e184) 2019-11-27T19:12:35.376 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:35.371+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:35.833 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:35.828+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:35.838 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:35.832+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:36.041 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:36.035+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:36.356 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:36.350+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:36.653 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:36.647+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:36.839 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:36.834+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:36.878 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:36.873+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:37.037 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:37.028+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:37.344 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:37.336+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:37.344 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:37.340+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:37.623 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:37.617+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:37.710 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:37.704+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:37.829 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:37.824+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:37.936 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:37.927+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:38.039 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:38.033+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:38.360 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:38.354+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:38.361 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:38.356+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:38.602 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:38.596+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:38.683 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:38.678+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:38.858 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:38.852+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:38.934 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:38.926+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:39.061 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:39.053+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:39.319 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:39.315+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:39.320 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:39.316+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:39.498 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:39.492+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:39.573 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:39.567+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:39.705 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:39.698+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:39.839 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:39.833+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:39.967 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:39.962+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:40.059 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:40.051+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:40.355 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:40.350+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:40.356 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:40.352+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:40.497 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:40.490+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:40.623 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:40.617+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:40.752 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:40.748+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:40.851 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:40.846+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:40.940 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:40.932+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:41.110 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:41.102+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:41.327 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:41.322+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:41.330 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:41.326+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:41.509 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:41.501+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:41.652 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:41.644+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:41.721 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:41.714+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:41.811 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:41.806+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:41.984 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:41.972+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:42.154 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:42.147+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:42.348 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:42.342+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:42.352 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:42.346+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:42.535 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:42.528+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:42.691 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:42.684+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:42.722 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:42.716+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:42.842 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:42.837+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:43.024 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:43.017+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:43.152 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:43.145+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:43.386 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:43.378+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:43.387 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:43.381+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:43.507 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:43.500+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:43.681 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:43.674+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:43.689 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:43.682+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:43.831 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:43.824+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:44.041 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:44.034+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:44.107 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:44.100+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:44.426 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:44.419+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:44.427 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:44.421+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:44.567 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:44.558+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:44.655 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:44.648+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:44.666 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:44.659+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:44.863 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:44.857+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:45.050 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:45.043+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:45.062 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:45.057+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:45.463 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:45.457+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:45.464 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:45.459+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:45.554 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:45.547+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:45.650 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:45.643+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:45.705 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:45.699+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:45.846 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:45.838+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:46.027 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:46.021+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:46.077 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:46.071+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:46.491 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:46.483+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:46.492 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:46.486+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:46.566 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:46.560+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:46.666 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:46.660+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:46.666 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:46.660+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:46.889 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:46.883+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:46.995 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:46.990+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:47.093 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:47.086+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:47.494 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:47.488+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:47.497 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:47.492+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:47.618 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:47.613+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:47.643 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:47.637+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:47.689 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:47.683+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:47.846 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:47.840+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:48.000 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:47.995+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:48.088 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:48.082+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:48.501 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:48.494+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:48.502 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:48.496+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:48.670 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:48.664+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:48.688 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:48.682+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:48.691 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:48.685+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:48.811 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:48.805+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:49.041 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:49.026+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:49.067 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:49.061+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:49.511 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:49.506+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:49.512 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:49.509+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:49.649 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:49.644+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:49.713 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:49.707+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:49.743 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:49.738+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:49.851 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:49.846+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:50.054 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:50.048+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:50.061 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:50.055+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:50.490 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:50.484+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:50.492 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:50.488+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:50.638 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:50.632+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:50.752 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:50.744+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:50.755 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:50.749+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:50.853 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:50.847+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:51.020 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:51.015+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:51.096 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:51.092+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:51.518 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:51.512+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:51.521 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:51.517+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:51.597 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:51.591+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:51.716 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:51.708+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:51.747 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:51.741+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:51.894 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:51.887+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:52.054 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:52.048+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:52.097 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:52.091+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:52.538 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:52.531+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:52.538 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:52.534+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:52.626 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:52.621+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:52.770 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:52.764+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:52.779 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:52.772+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:52.848 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:52.842+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:53.044 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:53.038+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:53.059 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:53.053+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:53.500 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:53.495+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:53.501 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:53.497+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:53.681 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:53.675+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:53.752 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:53.746+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:53.764 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:53.758+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:53.880 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:53.875+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:54.049 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:54.044+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:54.084 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:54.077+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:54.462 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:54.456+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:54.463 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:54.458+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:54.678 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:54.670+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:54.738 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:54.732+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:54.746 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:54.741+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:54.841 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:54.835+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:55.064 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:55.058+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:55.099 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:55.093+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:55.428 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:55.422+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:55.430 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:55.427+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:55.699 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:55.692+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:55.775 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:55.769+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:55.787 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:55.781+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:55.882 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:55.876+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:56.041 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:56.035+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:56.079 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:56.072+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:56.480 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:56.473+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:56.481 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:56.476+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:56.728 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:56.722+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:56.797 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:56.791+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:56.805 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:56.799+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:56.898 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:56.894+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:57.013 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:57.007+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:57.057 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:57.050+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:57.506 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:57.500+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:57.506 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:57.502+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:57.734 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:57.728+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:57.763 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:57.755+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:57.777 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:57.771+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:57.891 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:57.885+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:58.046 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:58.039+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:58.097 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:58.091+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:58.529 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:58.524+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:58.530 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:58.526+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:58.693 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:58.687+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:58.789 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:58.783+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:58.798 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:58.792+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:58.918 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:58.912+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:12:59.004 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:12:58.998+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:12:59.070 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:12:59.064+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:12:59.482 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:59.478+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:12:59.483 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:12:59.479+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:12:59.663 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:12:59.657+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:12:59.781 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:12:59.776+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:12:59.818 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:12:59.813+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:12:59.937 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:12:59.932+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:00.008 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:00.002+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:00.100 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:00.095+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:00.444 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:00.438+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:00.446 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:00.442+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:00.710 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:00.704+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:00.799 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:00.792+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:00.838 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:00.832+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:00.937 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:00.931+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:01.050 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:01.043+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:01.098 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:01.092+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:01.481 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:01.475+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:01.485 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:01.481+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:01.671 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:01.665+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:01.827 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:01.822+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:01.831 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:01.824+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:01.957 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:01.953+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:02.086 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:02.080+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:02.100 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:02.094+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:02.484 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:02.478+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:02.487 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:02.483+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:02.645 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:02.639+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:02.829 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:02.818+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:02.831 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:02.826+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:02.916 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:02.911+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:03.087 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:03.077+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:03.140 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:03.134+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:03.497 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:03.491+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:03.498 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:03.494+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:03.605 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:03.596+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:03.811 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:03.806+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:03.832 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:03.823+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:03.915 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:03.909+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:04.081 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:04.074+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:04.157 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:04.151+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:04.508 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:04.502+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:04.509 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:04.504+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:04.567 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:04.562+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:04.821 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:04.813+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:04.850 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:04.844+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:04.880 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:04.874+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:05.102 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:05.092+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:05.213 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:05.203+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:05.544 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:05.535+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:05.545 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:05.540+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:05.547 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:05.542+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:05.815 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:05.809+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:05.875 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:05.870+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:05.899 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:05.893+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:06.085 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:06.078+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:06.242 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:06.236+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:06.518 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:06.512+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:06.547 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:06.543+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:06.549 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:06.545+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:06.829 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:06.824+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:06.846 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:06.841+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:06.947 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:06.937+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:07.053 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:07.048+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:07.199 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:07.193+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:07.483 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:07.477+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:07.579 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:07.573+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:07.580 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:07.575+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:07.832 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:07.826+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:07.874 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:07.868+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:07.959 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:07.953+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:08.065 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:08.055+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:08.226 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:08.220+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:08.493 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:08.487+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:08.573 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:08.568+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:08.575 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:08.571+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:08.831 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:08.824+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:08.892 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:08.885+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:08.937 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:08.932+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:09.032 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:09.025+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:09.243 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:09.237+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:09.453 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:09.448+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:09.584 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:09.579+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:09.585 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:09.581+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:09.794 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:13:09.790+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.217227+0000 front 2019-11-27T19:11:54.221772+0000 (oldest deadline 2019-11-27T19:12:37.060508+0000) 2019-11-27T19:13:09.910 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:09.903+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:09.968 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:13:09.962+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.022369+0000 front 2019-11-27T19:11:54.015125+0000 (oldest deadline 2019-11-27T19:12:39.298454+0000) 2019-11-27T19:13:10.023 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:10.017+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:10.219 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:13:10.213+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:50.706262+0000 front 2019-11-27T19:11:50.838619+0000 (oldest deadline 2019-11-27T19:12:35.330855+0000) 2019-11-27T19:13:10.443 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:13:10.437+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:52.636340+0000 front 2019-11-27T19:11:52.622840+0000 (oldest deadline 2019-11-27T19:12:36.558014+0000) 2019-11-27T19:13:10.566 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:10.560+0000 1694c700 -1 osd.0 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.676490+0000 front 2019-11-27T19:11:53.528521+0000 (oldest deadline 2019-11-27T19:12:35.219550+0000) 2019-11-27T19:13:10.566 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:10.561+0000 1694c700 -1 osd.0 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:10.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:13:10.607+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 42sec e186 v186) 2019-11-27T19:13:10.907 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:10.902+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:11.031 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:13:11.026+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:54.225102+0000 front 2019-11-27T19:11:54.492219+0000 (oldest deadline 2019-11-27T19:12:35.868619+0000) 2019-11-27T19:13:11.569 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:11.565+0000 1694c700 -1 osd.0 187 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:11.927 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:13:11.921+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:11:53.170413+0000 front 2019-11-27T19:11:53.196797+0000 (oldest deadline 2019-11-27T19:12:35.288501+0000) 2019-11-27T19:13:12.718 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:12.714+0000 1694c700 -1 osd.0 188 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:13.716 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:13.713+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:14.725 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:14.720+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:15.704 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:15.700+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:16.749 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:16.744+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:17.765 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:17.761+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:18.785 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:18.781+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:19.800 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:19.795+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:20.808 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:20.804+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:21.803 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:21.795+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:22.813 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:22.808+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:23.847 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:23.843+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:24.857 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:24.852+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:25.905 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:25.900+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:26.955 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:26.950+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:27.985 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:27.980+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:29.007 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:29.004+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:30.019 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:30.015+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:31.066 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:31.061+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:32.029 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:32.024+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:33.070 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:33.065+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:34.117 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:34.111+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:35.155 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:35.150+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:36.159 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:36.153+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:37.202 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:37.198+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:38.198 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:38.194+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:39.226 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:39.221+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:40.201 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:40.197+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:41.239 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:41.235+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:42.205 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:13:42.201+0000 1694c700 -1 osd.0 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110287 6.5 6:a30f0fb7:root::7ac68dab939244c79adfa152b2f7ee2b:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e186) 2019-11-27T19:13:49.998 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:19:24.060 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.009 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:19:24.070 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.021 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:19:24.030 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.029 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:19:24.038 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.032 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:19:24.094 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.037 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:19:24.099 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.167 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:19:24.176 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.225 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:19:24.287 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.235 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:19:24.296 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-11-27T19:14:06.675 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:06.669+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:07.647 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:07.640+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:07.680 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:07.675+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:08.625 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:08.619+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:08.723 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:08.718+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:08.830 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:08.825+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:09.324 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:09.318+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:09.589 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:09.584+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:09.741 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:09.735+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:09.814 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:09.808+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:09.974 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:09.968+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:10.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:10.278+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:10.631 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:10.626+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:10.760 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:10.755+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:10.763 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:10.758+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:10.772 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:10.766+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:11.020 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:11.015+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:11.301 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:11.293+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:11.635 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:11.630+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:11.747 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:11.741+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:11.797 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:11.792+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:11.811 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:11.805+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:12.016 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:12.011+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:12.290 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:12.284+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:12.659 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:12.654+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:12.764 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:12.758+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:12.799 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:12.794+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:12.808 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:12.802+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:13.015 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:13.008+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:13.250 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:13.245+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:13.673 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:13.668+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:13.718 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:13.713+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:13.805 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:13.799+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:13.828 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:13.822+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:14.059 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:14.052+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:14.251 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:14.245+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:14.652 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:14.647+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:14.676 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:14.671+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:14.793 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:14.786+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:14.793 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:14.788+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:15.037 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:15.031+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:15.294 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:15.289+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:15.643 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:15.638+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:15.668 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:15.662+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:15.776 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:15.770+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:15.804 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:15.799+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:16.079 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:16.073+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:16.288 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:16.283+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:16.646 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:16.640+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:16.650 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:16.644+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:16.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:16.646+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:16.764 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:16.758+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:16.776 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:16.771+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:17.134 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:17.125+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:17.288 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:17.282+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:17.648 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:17.643+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:17.680 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:17.675+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:17.680 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:17.676+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:17.780 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:17.775+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:17.793 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:17.787+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:18.172 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:18.168+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:18.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:18.279+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:18.611 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:18.606+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:18.710 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:18.703+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:18.710 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:18.705+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:18.757 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:18.753+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:18.768 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:18.763+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:19.189 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:19.183+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:19.245 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:19.239+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:19.450 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:19.444+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:19.634 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:19.627+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:19.689 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:19.683+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:19.691 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:19.686+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:19.746 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:19.741+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:19.775 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:19.769+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:20.230 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:20.223+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:20.284 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:20.277+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:20.486 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:20.479+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:20.645 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:20.638+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:20.726 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:20.720+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:20.739 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:20.733+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:20.741 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:20.736+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:20.817 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:20.811+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:21.258 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:21.253+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:21.281 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:21.275+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:21.474 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:21.468+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:21.677 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:21.670+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:21.720 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:21.714+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:21.744 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:21.737+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:21.745 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:21.739+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:21.803 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:21.796+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:22.301 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:22.290+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:22.301 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:22.294+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:22.476 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:22.471+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:22.681 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:22.674+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:22.760 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:22.755+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:22.764 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:22.757+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:22.765 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:22.759+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:22.833 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:22.827+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:23.261 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:23.254+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:23.310 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:23.303+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:23.477 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:23.471+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:23.706 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:23.700+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:23.765 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:23.760+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:23.768 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:23.764+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:23.816 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:23.811+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:23.880 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:23.874+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:24.252 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:24.245+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:24.330 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:24.325+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:24.509 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:24.502+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:24.752 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:24.746+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:24.818 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:24.811+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:24.819 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:24.814+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:24.869 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:24.863+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:24.893 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:24.886+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:25.261 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:25.255+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:25.368 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:25.361+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:25.498 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:25.492+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:25.768 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:25.763+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:25.824 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:25.820+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:25.826 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:25.822+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:25.892 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:25.886+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:25.934 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:25.926+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:26.274 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:26.265+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:26.365 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:26.360+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:26.529 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:26.522+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:26.532 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:26.525+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:26.797 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:26.791+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:26.857 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:26.851+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:26.857 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:26.853+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:26.904 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:26.899+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:26.940 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:26.934+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:27.235 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:27.231+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:27.359 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:27.354+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:27.564 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:27.557+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:27.566 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:27.560+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:27.803 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:27.798+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:27.889 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:27.885+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:27.891 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:27.887+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:27.932 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:27.927+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:27.989 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:27.984+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:28.255 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:28.248+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:28.331 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:28.325+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:28.548 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:28.542+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:28.554 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:28.548+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:28.782 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:28.777+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:28.879 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:28.872+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:28.879 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:28.874+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:28.966 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:28.960+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:28.983 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:28.976+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:29.265 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:29.259+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:29.344 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:29.340+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:29.567 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:29.561+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:29.569 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:29.563+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:29.834 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:29.830+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:29.923 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:29.918+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:29.924 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:29.921+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:29.964 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:29.959+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:29.988 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:29.983+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:30.259 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:30.254+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:30.314 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:30.310+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:30.541 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:30.534+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:30.543 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:30.537+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:30.838 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:30.832+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:30.928 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:30.923+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:30.972 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:30.966+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:30.973 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:30.968+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:31.023 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:31.017+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:31.283 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:31.277+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:31.301 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:31.295+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:31.544 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:31.539+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:31.545 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:31.540+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:31.801 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:31.795+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:31.925 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:31.919+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:31.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:31.947+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:31.955 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:31.949+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:31.983 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:31.977+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:32.265 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:32.260+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:32.268 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:32.262+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:32.506 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:32.500+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:32.508 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:32.502+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:32.763 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:32.757+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:32.943 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:32.937+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:32.947 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:32.941+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:32.947 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:32.943+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:33.029 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:33.023+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:33.267 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:33.261+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:33.296 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:33.291+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:33.485 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:33.480+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:33.489 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:33.484+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:33.800 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:33.794+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:33.902 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:33.898+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:33.904 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:33.900+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:33.987 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:33.982+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:34.000 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:33.994+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:34.267 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:34.261+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:34.319 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:34.314+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:34.503 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:34.498+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:34.506 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:34.502+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:34.834 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:34.829+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:34.883 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:34.877+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:34.883 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:34.879+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:34.958 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:34.953+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:34.964 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:34.959+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:35.291 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:35.286+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:35.374 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:35.369+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:35.496 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:35.490+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:35.497 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:35.492+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:35.794 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:35.789+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:35.918 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:35.913+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:35.921 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:35.917+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:35.950 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:35.945+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:36.014 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:36.008+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:36.270 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:36.264+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:36.393 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:36.388+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:36.479 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:36.474+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:36.485 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:36.480+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:36.809 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:36.803+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:36.948 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:36.942+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:36.974 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:36.966+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:36.978 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:36.970+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:37.011 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:37.006+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:37.302 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:37.297+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:37.375 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:37.370+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:37.454 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:37.448+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:37.454 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:37.450+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:37.766 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:37.761+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:37.914 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:37.909+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:37.972 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:37.967+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:37.973 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:37.968+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:38.012 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:38.006+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:38.271 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:38.266+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:38.409 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:38.404+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:38.484 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:38.479+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:38.487 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:38.483+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:38.818 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:38.813+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:38.877 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:38.871+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:38.998 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:38.993+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:38.999 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:38.994+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:39.032 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:39.026+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:39.323 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:39.318+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:39.463 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:39.458+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:39.497 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:39.492+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:39.501 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:39.497+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:39.815 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:39.811+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:39.887 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:39.881+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:39.996 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:39.989+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:39.997 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:39.993+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:40.011 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:40.006+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:40.371 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:40.365+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:40.437 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:40.431+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:40.524 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:40.518+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:40.526 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:40.520+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:40.831 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:40.825+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:40.850 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:40.844+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:40.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:14:40.943+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e193 v193) 2019-11-27T19:14:41.014 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:41.009+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:41.015 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:41.010+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:41.052 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:41.046+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:41.351 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:41.345+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:41.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:41.401+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:41.527 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:41.520+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:41.528 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:41.523+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:41.812 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:41.807+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:41.871 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:41.865+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:42.005 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:41.998+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:42.007 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:42.003+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:42.087 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:42.081+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:42.310 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:42.305+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:42.362 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:42.356+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:42.565 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:42.560+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:42.570 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:42.565+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:42.855 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:42.849+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:42.862 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:42.857+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:43.002 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:42.996+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:43.003 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:42.998+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:43.062 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:43.057+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:43.327 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:43.321+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:43.351 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:43.344+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:43.607 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:43.601+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:43.608 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:43.603+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:43.820 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:43.814+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:43.840 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:43.834+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:44.029 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:44.022+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:44.029 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:44.025+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:44.032 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:44.028+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:44.312 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:44.306+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:44.383 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:44.378+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:44.663 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:44.656+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:44.665 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:44.659+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:44.811 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:44.805+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:44.834 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:44.828+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:45.016 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:45.011+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:45.022 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:45.017+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:45.025 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:45.020+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:45.314 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:45.309+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:45.341 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:45.336+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:45.632 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:45.628+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:45.635 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:45.631+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:45.798 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:45.794+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:45.878 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:45.872+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:45.969 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:14:45.962+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e193 v193) 2019-11-27T19:14:45.983 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:45.977+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:45.986 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:45.981+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:46.043 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:46.039+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:46.312 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:46.306+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:46.323 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:46.317+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:46.614 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:46.606+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:46.615 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:46.610+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:46.816 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:46.810+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:46.931 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:46.924+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:46.954 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:46.948+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:46.954 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:46.950+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:47.086 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:47.081+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:47.273 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:47.267+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:47.327 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:47.321+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:47.620 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:47.613+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:47.622 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:47.616+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:47.867 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:47.863+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:47.952 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:47.947+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:47.981 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:47.977+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:47.984 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:47.980+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:48.117 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:48.111+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:48.303 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:48.298+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:48.311 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:48.307+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:48.360 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:48.355+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:48.611 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:48.605+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:48.616 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:48.611+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:48.835 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:48.830+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:48.966 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:48.960+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:48.974 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:48.967+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:48.975 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:48.969+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:49.097 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:49.092+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:49.298 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:49.292+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:49.299 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:49.294+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:49.325 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:49.318+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:49.623 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:49.613+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:49.624 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:49.617+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:49.827 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:49.822+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:49.962 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:49.956+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:49.998 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:49.991+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:49.999 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:49.994+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:50.128 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:50.123+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:50.260 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:50.255+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:50.262 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:50.258+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:50.325 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:50.320+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:50.620 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:50.612+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:50.621 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:50.616+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:50.881 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:50.876+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:50.927 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:50.922+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:50.968 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:50.964+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:50.971 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:50.966+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:50.991 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:14:50.983+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e193 v193) 2019-11-27T19:14:51.157 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:51.152+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:51.297 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:51.292+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:51.298 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:51.294+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:51.299 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:51.295+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:51.662 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:51.655+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:51.664 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:51.658+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:51.867 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:51.862+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:51.924 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:51.919+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:51.952 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:51.947+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:51.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:51.948+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:52.202 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:52.196+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:52.278 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:52.273+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:52.302 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:52.297+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:52.302 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:52.298+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:52.654 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:52.648+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:52.658 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:52.653+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:52.896 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:52.891+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:52.906 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:52.901+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:52.958 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:52.951+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:52.959 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:52.954+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:53.249 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:53.244+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:53.261 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:53.256+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:53.261 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:53.257+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:53.324 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:53.318+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:53.634 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:53.627+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:53.635 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:53.630+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:53.867 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:53.861+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:53.903 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:53.898+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:53.971 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:53.965+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:53.972 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:53.967+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:54.241 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:54.235+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:54.262 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:54.257+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:54.263 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:54.258+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:54.334 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:54.321+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:54.645 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:54.637+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:54.647 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:54.641+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:54.846 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:54.841+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:54.890 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:54.884+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:54.998 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:54.992+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:54.999 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:54.994+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:55.214 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:14:55.209+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.238260+0000 front 2019-11-27T19:13:26.282650+0000 (oldest deadline 2019-11-27T19:14:10.234868+0000) 2019-11-27T19:14:55.298 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:55.293+0000 1694c700 -1 osd.3 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:24.724007+0000 front 2019-11-27T19:13:24.727878+0000 (oldest deadline 2019-11-27T19:14:09.067878+0000) 2019-11-27T19:14:55.299 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:55.294+0000 1694c700 -1 osd.3 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:55.325 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:14:55.319+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:27.689031+0000 front 2019-11-27T19:13:27.687159+0000 (oldest deadline 2019-11-27T19:14:09.704455+0000) 2019-11-27T19:14:55.637 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:55.631+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:13:46.116303+0000 (oldest deadline 2019-11-27T19:14:26.116303+0000) 2019-11-27T19:14:55.639 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:55.634+0000 1694c700 -1 osd.1 193 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:55.840 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:14:55.835+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.034767+0000 front 2019-11-27T19:13:27.521601+0000 (oldest deadline 2019-11-27T19:14:07.303321+0000) 2019-11-27T19:14:55.947 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:14:55.933+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:28.029102+0000 front 2019-11-27T19:13:28.035971+0000 (oldest deadline 2019-11-27T19:14:08.626422+0000) 2019-11-27T19:14:56.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:14:56.049+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e193 v193) 2019-11-27T19:14:56.124 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:55.997+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:13:26.944170+0000 front 2019-11-27T19:13:28.033682+0000 (oldest deadline 2019-11-27T19:14:06.598893+0000) 2019-11-27T19:14:56.124 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:55.998+0000 1694c700 -1 osd.7 193 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:56.395 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:56.378+0000 1694c700 -1 osd.3 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:56.791 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:14:56.755+0000 1694c700 -1 osd.1 194 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-27T19:14:57.021 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:57.017+0000 1694c700 -1 osd.7 194 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:57.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:57.360+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:58.042 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:58.038+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:58.375 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:58.372+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:14:59.034 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:14:59.030+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:14:59.384 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:14:59.379+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:00.071 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:00.066+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:00.347 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:00.342+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:01.114 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:01.109+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:01.399 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:01.395+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:02.109 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:02.104+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:02.368 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:02.364+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:03.101 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:03.096+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:03.389 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:03.384+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:04.070 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:04.065+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:04.435 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:04.430+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:05.060 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:05.055+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:05.454 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:05.450+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:06.086 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:06.081+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:06.459 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:06.455+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:07.133 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:07.122+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:07.470 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:07.466+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:08.160 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:08.154+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:08.438 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:08.434+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:09.203 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:09.197+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:09.401 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:09.395+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:10.205 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:10.198+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:10.381 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:10.376+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:11.205 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:11.199+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:11.402 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:11.396+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:12.175 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:12.168+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:12.399 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:12.394+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:13.168 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:13.163+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:13.449 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:13.444+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:14.130 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:14.124+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:14.444 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:14.439+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:15.116 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:15.110+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:15.410 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:15:15.405+0000 1694c700 -1 osd.3 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110541 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821144096 gen 56] snapc 0=[] ondisk+write+known_if_redirected e193) 2019-11-27T19:15:16.108 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:16.102+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:17.119 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:17.114+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:18.095 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:18.089+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:19.149 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:19.143+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:20.156 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:20.151+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:21.189 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:21.183+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:22.222 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:22.217+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:23.212 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:23.207+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:24.218 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:24.213+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:25.184 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:25.179+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:26.201 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:26.195+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:26.827 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:15:26.818+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110601 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 84] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-11-27T19:15:27.216 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:27.210+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:27.810 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:15:27.674+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 1 slow ops, oldest is osd_repop(osd.7.0:9043 5.5 e193/184 5:a93a5511:::notify.2:head v 193'162) 2019-11-27T19:15:27.882 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:15:27.878+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110601 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 84] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-11-27T19:15:28.211 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:15:28.207+0000 1694c700 -1 osd.7 195 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:110463 5.5 5:a93a5511:::notify.2:head [watch ping cookie 821180096 gen 2] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T19:15:29.105 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:15:29.093+0000 20e22700 -1 RGWWatcher::handle_error cookie 821180096 err (107) Transport endpoint is not connected 2019-11-27T19:16:01.542 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:01.537+0000 1694c700 -1 osd.4 199 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110662 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 85] snapc 0=[] ondisk+write+known_if_redirected e197) 2019-11-27T19:16:02.537 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:02.533+0000 1694c700 -1 osd.4 199 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110662 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 85] snapc 0=[] ondisk+write+known_if_redirected e197) 2019-11-27T19:16:03.573 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:03.569+0000 1694c700 -1 osd.4 199 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110664 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 821242208 gen 84] snapc 0=[] ondisk+write+known_if_redirected e197) 2019-11-27T19:16:36.909 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:36.902+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:37.162 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:37.156+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:37.466 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:37.459+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:37.834 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:37.828+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:37.871 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:37.865+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:38.150 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:38.144+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:38.238 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:38.232+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:38.478 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:38.471+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:38.506 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:38.500+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:38.866 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:38.859+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:38.896 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:38.891+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:39.191 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:39.185+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:39.244 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:39.238+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:39.261 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:39.255+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:39.471 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:39.464+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:39.520 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:39.515+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:39.877 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:39.871+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:39.922 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:39.916+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:40.213 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:40.206+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:40.222 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:40.216+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:40.293 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:40.288+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:40.497 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:40.490+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:40.550 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:40.544+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:40.885 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:40.878+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:40.907 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:40.901+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:41.226 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:41.220+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:41.268 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:41.263+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:41.319 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:41.313+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:41.489 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:41.480+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:41.540 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:41.532+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:41.923 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:41.917+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:41.927 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:41.921+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:42.209 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:42.202+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:42.288 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:42.282+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:42.356 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:42.350+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:42.455 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:42.443+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:42.542 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:42.536+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:42.925 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:42.919+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:42.953 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:42.946+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:43.236 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:43.230+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:43.270 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:43.264+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:43.372 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:43.365+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:43.497 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:43.489+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:43.588 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:43.582+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:43.951 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:43.945+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:43.953 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:43.947+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:44.260 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:44.255+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:44.267 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:44.261+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:44.366 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:44.361+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:44.505 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:44.499+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:44.547 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:44.542+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:44.993 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:44.988+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:44.996 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:44.990+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:45.254 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:45.249+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:45.264 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:45.260+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:45.408 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:45.401+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:45.559 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:45.553+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:45.567 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:45.560+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:46.009 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:46.003+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:46.044 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:46.037+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:46.248 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:46.242+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:46.305 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:46.297+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:46.452 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:46.445+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:46.578 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:46.572+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:46.585 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:46.578+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:46.984 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:46.976+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:47.005 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:46.999+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:47.218 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:47.208+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:47.352 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:47.345+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:47.429 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:47.421+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:47.537 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:47.530+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:47.545 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:47.538+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:47.994 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:47.986+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:48.036 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:48.030+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:48.216 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:48.208+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:48.315 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:48.307+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:48.479 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:48.473+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:48.534 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:48.527+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:48.576 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:48.569+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:48.974 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:48.966+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:49.064 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:49.057+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:49.215 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:49.207+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:49.365 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:49.358+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:49.515 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:49.509+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:49.518 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:49.511+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:49.599 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:49.593+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:49.986 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:49.979+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:50.097 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:50.089+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:50.179 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:50.172+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:50.333 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:50.324+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:50.496 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:50.488+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:50.532 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:50.526+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:50.560 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:50.553+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:51.009 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:51.003+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:51.148 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:51.136+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:51.191 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:51.185+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:51.353 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:51.347+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:51.533 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:51.527+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:51.564 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:51.557+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:51.597 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:51.591+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:52.001 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:51.995+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:52.195 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:52.189+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:52.198 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:52.193+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:52.319 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:52.313+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:52.567 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:52.562+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:52.571 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:52.566+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:52.641 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:52.634+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:52.961 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:52.955+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:53.191 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:53.186+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:53.210 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:53.203+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:53.314 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:53.308+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:53.533 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:53.527+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:53.615 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:53.611+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:53.674 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:53.668+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:53.978 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:53.973+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:54.178 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:54.172+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:54.192 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:54.186+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:54.305 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:54.300+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:54.563 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:54.557+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:54.625 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:54.619+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:54.669 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:54.664+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:54.964 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:54.957+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:55.158 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:55.152+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:55.182 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:55.176+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:55.272 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:55.267+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:55.549 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:55.543+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:55.639 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:55.634+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:55.701 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:55.695+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:56.001 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:55.990+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:56.168 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:56.162+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:56.194 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:56.188+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:56.261 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:56.255+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:56.569 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:56.563+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:56.681 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:56.675+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:56.730 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:56.724+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:57.040 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:57.034+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:57.138 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:57.132+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:57.231 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:57.226+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:57.265 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:57.260+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:57.609 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:57.602+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:57.726 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:57.721+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:57.781 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:57.775+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:58.046 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:58.039+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:58.136 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:58.130+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:58.225 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:58.220+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:58.228 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:58.222+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:58.616 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:58.609+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:58.689 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:58.684+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:58.781 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:58.775+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:16:59.054 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:16:59.044+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:16:59.141 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:16:59.135+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:16:59.191 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:16:59.184+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:16:59.212 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:16:59.207+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:16:59.585 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:16:59.579+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:16:59.730 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:16:59.724+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:16:59.755 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:16:59.749+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:00.096 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:00.090+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:00.140 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:00.134+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:00.202 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:00.197+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:00.214 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:00.209+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:00.578 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:00.572+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:00.739 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:00.734+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:00.776 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:00.770+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:01.109 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:01.104+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:01.142 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:01.135+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:01.190 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:01.185+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:01.240 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:01.235+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:01.554 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:01.546+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:01.694 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:01.690+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:01.809 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:01.802+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:02.143 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:02.136+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:02.146 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:02.141+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:02.152 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:02.146+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:02.252 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:02.245+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:02.587 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:02.580+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:02.679 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:02.673+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:02.765 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:02.759+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:03.155 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:03.148+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:03.156 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:03.150+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:03.162 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:03.156+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:03.269 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:03.254+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:03.567 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:03.560+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:03.702 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:03.697+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:03.749 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:03.733+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:04.136 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:04.130+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:04.179 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:04.173+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:04.193 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:04.188+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:04.242 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:04.235+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:04.573 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:04.567+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:04.665 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:04.661+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:04.728 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:04.721+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:05.118 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:05.111+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:05.157 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:05.153+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:05.204 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:05.198+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:05.208 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:05.202+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:05.610 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:05.605+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:05.639 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:05.635+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:05.688 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:05.683+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:06.164 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:06.159+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:06.171 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:06.164+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:06.225 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:06.219+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:06.227 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:06.222+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:06.595 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:06.589+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:06.618 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:06.612+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:06.716 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:06.711+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:07.155 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:07.150+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:07.156 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:07.150+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:07.193 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:07.187+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:07.250 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:07.243+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:07.568 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:07.563+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:07.646 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:07.640+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:07.672 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:07.666+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:08.142 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:08.136+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:08.179 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:08.174+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:08.184 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:08.178+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:08.250 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:08.244+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:08.586 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:08.580+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:08.624 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:08.618+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:08.716 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:08.710+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:09.106 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:09.100+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:09.132 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:09.127+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:09.166 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:09.159+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:09.293 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:09.287+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:09.573 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:09.567+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:09.619 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:09.613+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:09.705 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:09.700+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:10.117 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:10.111+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:10.143 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:10.137+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:10.190 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:10.183+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:10.339 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:10.333+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:10.598 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:10.592+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:10.669 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:17:10.662+0000 1694c700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.052707+0000 front 2019-11-27T19:15:56.055076+0000 (oldest deadline 2019-11-27T19:16:38.220739+0000) 2019-11-27T19:17:10.757 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:17:10.751+0000 1694c700 -1 osd.6 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:53.724742+0000 front 2019-11-27T19:15:53.731753+0000 (oldest deadline 2019-11-27T19:16:37.343701+0000) 2019-11-27T19:17:11.121 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:11.115+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:11.167 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:11.161+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:11.208 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:17:11.202+0000 1694c700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:56.708831+0000 front 2019-11-27T19:15:56.530452+0000 (oldest deadline 2019-11-27T19:16:37.565794+0000) 2019-11-27T19:17:11.308 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:17:11.304+0000 1694c700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.654261+0000 front 2019-11-27T19:15:55.645743+0000 (oldest deadline 2019-11-27T19:16:36.721958+0000) 2019-11-27T19:17:11.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:17:11.489+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 42sec e199 v199) 2019-11-27T19:17:11.592 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:17:11.587+0000 1694c700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147297+0000 front 2019-11-27T19:15:55.148575+0000 (oldest deadline 2019-11-27T19:16:37.939320+0000) 2019-11-27T19:17:12.170 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:17:12.165+0000 1694c700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.145414+0000 front 2019-11-27T19:15:54.969775+0000 (oldest deadline 2019-11-27T19:16:38.575707+0000) 2019-11-27T19:17:12.178 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:17:12.173+0000 1694c700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:15:55.147653+0000 front 2019-11-27T19:15:54.124220+0000 (oldest deadline 2019-11-27T19:16:36.764115+0000) 2019-11-27T19:17:41.911 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:23:15.972 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:41.942 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:23:16.004 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:41.993 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:23:16.051 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:41.993 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:23:16.053 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:42.046 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:23:16.055 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:42.051 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:23:16.061 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:42.184 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:23:16.245 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:42.224 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:23:16.285 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:42.417 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:23:16.426 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.062 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:23:21.124 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.072 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:23:21.134 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.085 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:23:21.147 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.088 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:23:21.149 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.092 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:23:21.101 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.106 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:23:21.115 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.109 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:23:21.171 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.130 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:23:21.192 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:17:47.182 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:23:21.191 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:18:08.015 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:08.001+0000 1694c700 -1 osd.5 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:08.605 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:08.599+0000 1694c700 -1 osd.0 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:09.046 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:09.040+0000 1694c700 -1 osd.5 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:09.066 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:09.061+0000 1694c700 -1 osd.7 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:09.117 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:09.110+0000 11cac700 -1 osd.0 205 build_incremental_map_msg missing incremental map 203 2019-11-27T19:18:09.558 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:09.554+0000 1694c700 -1 osd.0 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:09.647 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:09.643+0000 1694c700 -1 osd.3 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:10.018 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:10.012+0000 1694c700 -1 osd.5 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:10.118 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:10.113+0000 1694c700 -1 osd.7 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:10.536 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:10.531+0000 1694c700 -1 osd.0 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:10.587 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:10.581+0000 1694c700 -1 osd.6 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:10.617 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:10.611+0000 1694c700 -1 osd.3 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:11.062 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:11.057+0000 1694c700 -1 osd.5 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:11.171 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:11.166+0000 1694c700 -1 osd.7 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:11.486 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:11.480+0000 1694c700 -1 osd.2 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:11.537 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:11.533+0000 1694c700 -1 osd.0 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:11.544 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:11.538+0000 1694c700 -1 osd.6 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:11.586 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:11.580+0000 1694c700 -1 osd.3 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:12.077 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:12.072+0000 1694c700 -1 osd.5 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:12.172 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:12.167+0000 1694c700 -1 osd.7 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:12.471 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:12.466+0000 1694c700 -1 osd.2 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:12.584 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:12.577+0000 1694c700 -1 osd.3 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:12.585 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:12.580+0000 1694c700 -1 osd.0 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:12.681 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:12.634+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:13.113 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:13.109+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:13.202 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:13.196+0000 1694c700 -1 osd.7 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:13.204 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:13.200+0000 1694c700 -1 osd.7 205 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:13.474 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:13.468+0000 1694c700 -1 osd.2 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:13.564 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:13.558+0000 1694c700 -1 osd.0 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:13.586 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:13.581+0000 1694c700 -1 osd.3 205 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:13.720 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:13.715+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:14.094 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:14.088+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:14.192 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:14.187+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:14.193 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:14.188+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:14.438 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:14.433+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:14.548 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:14.543+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:14.563 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:14.559+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:14.758 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:14.753+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:15.107 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:15.102+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:15.245 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:15.239+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:15.246 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:15.241+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:15.394 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:15.388+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:15.509 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:15.505+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:15.530 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:15.525+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:15.804 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:15.799+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:16.075 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:16.070+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:16.262 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:16.256+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:16.263 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:16.258+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:16.391 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:16.385+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:16.546 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:16.540+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:16.548 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:16.542+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:16.774 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:16.769+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:17.062 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:17.055+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:17.290 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:17.285+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:17.291 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:17.286+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:17.352 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:17.347+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:17.505 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:17.499+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:17.523 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:17.518+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:17.815 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:17.810+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:18.087 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:18.083+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:18.302 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:18.297+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:18.306 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:18.302+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:18.314 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:18.308+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:18.497 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:18.492+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:18.550 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:18.544+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:18.860 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:18.851+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:19.119 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:19.114+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:19.296 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:19.290+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:19.335 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:19.330+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:19.338 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:19.334+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:19.513 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:19.506+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:19.519 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:19.514+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:19.897 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:19.892+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:20.153 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:20.147+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:20.303 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:20.298+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:20.306 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:20.302+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:20.327 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:20.323+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:20.518 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:20.513+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:20.525 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:20.519+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:20.892 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:20.886+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:21.177 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:21.172+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:21.286 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:21.281+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:21.286 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:21.282+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:21.292 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:21.287+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:21.480 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:21.475+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:21.506 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:21.500+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:21.930 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:21.925+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:22.217 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:22.210+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:22.313 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:22.306+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:22.314 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:22.308+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:22.341 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:22.337+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:22.478 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:22.473+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:22.524 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:22.517+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:22.936 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:22.930+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:23.207 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:23.201+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:23.309 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:23.302+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:23.311 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:23.304+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:23.364 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:23.360+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:23.479 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:23.474+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:23.488 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:23.484+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:23.970 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:23.965+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:24.250 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:24.244+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:24.290 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:24.284+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:24.291 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:24.286+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:24.415 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:24.405+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:24.450 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:24.443+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:24.510 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:24.503+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:24.954 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:24.949+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:25.234 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:25.229+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:25.305 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:25.300+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:25.307 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:25.302+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:25.369 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:25.363+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:25.464 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:25.458+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:25.495 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:25.489+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:25.948 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:25.941+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:26.206 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:26.199+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:26.308 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:26.302+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:26.312 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:26.306+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:26.352 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:26.345+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:26.438 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:26.431+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:26.490 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:26.483+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:26.985 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:26.979+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:27.248 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:27.242+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:27.304 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:27.297+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:27.305 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:27.299+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:27.369 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:27.363+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:27.422 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:27.417+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:27.519 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:27.513+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:28.038 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:28.031+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:28.269 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:28.262+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:28.331 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:28.324+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:28.332 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:28.326+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:28.348 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:28.342+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:28.435 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:28.428+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:28.479 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:28.471+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:28.656 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:28.649+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:29.048 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:29.042+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:29.289 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:29.282+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:29.324 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:29.317+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:29.341 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:29.333+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:29.342 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:29.336+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:29.486 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:29.481+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:29.509 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:29.504+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:29.641 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:29.635+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:30.009 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:30.002+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:30.306 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:30.300+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:30.321 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:30.315+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:30.333 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:30.326+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:30.333 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:30.328+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:30.497 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:30.491+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:30.522 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:30.516+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:30.629 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:30.623+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:31.059 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:31.054+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:31.282 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:31.278+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:31.306 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:31.300+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:31.309 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:31.305+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:31.356 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:31.352+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:31.501 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:31.495+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:31.569 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:31.562+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:31.667 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:31.662+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:32.097 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:32.092+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:32.323 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:32.318+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:32.350 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:32.343+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:32.351 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:32.345+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:32.400 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:32.393+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:32.538 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:32.533+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:32.594 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:32.586+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:32.708 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:32.702+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:33.087 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:33.082+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:33.374 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:33.369+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:33.398 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:33.392+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:33.399 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:33.394+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:33.428 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:33.422+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:33.507 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:33.501+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:33.637 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:33.633+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:33.707 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:33.701+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:34.061 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:34.056+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:34.331 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:34.325+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:34.384 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:34.379+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:34.387 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:34.383+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:34.404 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:34.398+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:34.520 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:34.514+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:34.600 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:34.594+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:34.802 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:34.795+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:35.068 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:35.063+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:35.372 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:35.367+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:35.377 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:35.372+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:35.382 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:35.377+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:35.415 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:35.410+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:35.512 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:35.505+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:35.565 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:35.560+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:35.822 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:35.816+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:36.045 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:36.039+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:36.387 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:36.382+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:36.415 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:36.409+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:36.415 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:36.409+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:36.416 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:36.411+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:36.515 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:36.508+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:36.577 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:36.571+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:36.874 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:36.864+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:36.875 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:36.869+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:37.047 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:37.042+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:37.380 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:37.375+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:37.424 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:37.418+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:37.427 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:37.423+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:37.453 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:37.447+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:37.511 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:37.505+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:37.587 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:37.581+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:37.889 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:37.882+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:37.891 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:37.885+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:38.101 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:38.096+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:38.377 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:38.372+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:38.411 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:38.405+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:38.429 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:38.424+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:38.434 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:38.430+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:38.551 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:38.546+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:38.569 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:38.564+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:38.924 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:38.919+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:38.928 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:38.924+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:39.132 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:39.126+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:39.348 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:39.342+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:39.436 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:39.428+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:39.436 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:39.431+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:39.437 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:39.432+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:39.537 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:39.531+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:39.619 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:39.614+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:39.933 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:39.928+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:39.937 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:39.933+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:40.139 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:40.133+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:40.338 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:40.332+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:40.425 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:40.419+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:40.426 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:40.421+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:40.483 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:40.476+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:40.513 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:40.507+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:40.596 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:40.590+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:40.930 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:40.925+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:40.936 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:40.930+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:41.106 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:41.101+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:41.295 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:41.290+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:41.430 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:41.425+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:41.433 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:41.429+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:41.453 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:41.448+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:41.560 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:41.553+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:41.639 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:41.634+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:41.906 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:41.898+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:41.908 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:41.902+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:42.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:18:42.055+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 49sec e205 v205) 2019-11-27T19:18:42.104 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:42.093+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:42.268 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:42.262+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:42.411 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:42.406+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:42.433 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:42.428+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:42.436 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:42.431+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:42.594 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:42.586+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:42.619 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:42.615+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:42.880 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:42.875+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:42.885 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:42.880+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:43.142 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:43.133+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:43.294 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:43.288+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:43.457 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:43.451+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:43.469 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:43.464+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:43.473 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:43.468+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:43.576 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:43.571+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:43.656 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:43.651+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:43.924 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:43.915+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:43.925 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:43.919+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:44.150 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:44.144+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:44.340 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:44.334+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:44.448 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:44.439+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:44.450 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:44.442+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:44.452 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:44.446+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:44.549 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:44.541+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:44.626 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:44.620+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:44.941 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:44.933+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:44.942 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:44.937+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:45.185 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:45.180+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:45.341 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:45.335+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:45.444 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:45.437+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:45.445 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:45.439+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:45.465 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:45.459+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:45.519 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:45.509+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:45.617 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:45.612+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:45.936 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:45.930+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:45.937 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:45.932+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:46.225 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:46.218+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:46.303 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:46.297+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:46.461 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:46.456+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:46.465 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:46.461+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:46.473 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:46.468+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:46.484 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:46.478+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:46.589 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:46.584+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:46.892 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:46.885+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:46.893 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:46.888+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:47.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:18:47.070+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 49sec e205 v205) 2019-11-27T19:18:47.232 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:47.228+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:47.308 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:47.303+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:47.443 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:47.436+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:47.444 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:47.438+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:47.457 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:47.451+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:47.480 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:47.475+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:47.566 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:47.560+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:47.864 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:47.859+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:47.868 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:47.863+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:48.258 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:48.252+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:48.336 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:48.331+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:48.411 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:48.406+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:48.443 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:48.438+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:48.443 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:48.439+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:48.502 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:48.497+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:48.543 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:48.539+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:48.843 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:48.835+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:48.844 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:48.838+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:49.266 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:49.260+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:49.345 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:49.339+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:49.385 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:49.379+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:49.488 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:49.483+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:49.493 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:49.488+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:49.497 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:49.493+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:49.524 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:49.518+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:49.871 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:49.866+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:49.877 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:49.871+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:50.235 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:50.229+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:50.338 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:50.332+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:50.425 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:50.420+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:50.456 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:50.448+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:50.458 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:50.452+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:50.541 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:50.535+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:50.568 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:50.562+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:50.903 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:50.895+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:50.905 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:50.899+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:51.273 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:51.268+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:51.366 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:51.361+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:51.429 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:51.424+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:51.454 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:51.449+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:51.458 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:51.454+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:51.583 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:51.578+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:51.587 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:51.582+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:51.925 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:51.920+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:51.931 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:51.925+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:52.096 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:18:52.088+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 49sec e205 v205) 2019-11-27T19:18:52.269 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:52.265+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:52.413 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:52.408+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:52.467 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:52.461+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:52.472 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:52.466+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:52.474 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:52.468+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:52.548 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:52.542+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:52.587 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:52.582+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:52.922 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:52.915+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:52.924 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:52.918+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:53.304 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:53.300+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:53.429 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:53.424+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:53.452 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:53.446+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:53.505 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:53.499+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:53.509 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:53.504+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:53.536 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:53.530+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:53.618 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:53.612+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:53.937 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:53.932+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:53.941 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:53.936+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:54.353 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:54.348+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:54.450 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:54.445+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:54.473 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:54.468+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:54.482 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:54.477+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:54.486 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:54.481+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:54.582 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:54.577+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:54.642 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:54.636+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:54.970 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:54.965+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:54.971 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:54.967+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:55.385 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:55.380+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:55.417 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:55.409+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:55.490 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:55.485+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:55.493 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:55.488+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:55.509 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:55.504+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:55.563 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:55.557+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:55.671 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:55.667+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:55.928 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:55.921+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:55.930 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:55.925+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:56.370 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:56.366+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:56.459 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:56.454+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:56.462 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:56.458+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:56.465 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:56.460+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:56.521 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:56.516+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:56.535 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:56.529+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:56.662 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:56.654+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:56.926 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:56.920+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:56.930 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:56.925+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:57.111 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:18:57.105+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 49sec e205 v205) 2019-11-27T19:18:57.406 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:57.401+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:57.432 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:57.425+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:57.433 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:57.428+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:57.489 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:57.484+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:57.527 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:57.522+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:57.557 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:57.551+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:57.673 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:57.667+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:57.975 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:57.969+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:57.976 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:57.971+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:58.363 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:58.358+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:58.413 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:58.407+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:58.414 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:58.409+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:58.529 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:58.524+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:58.553 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:58.547+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:58.571 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:58.566+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:58.635 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:58.630+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:58.953 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:58.948+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:58.963 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:58.956+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:18:59.335 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:18:59.329+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:18:59.416 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:59.409+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:18:59.418 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:18:59.411+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:18:59.563 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:18:59.558+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:18:59.569 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:18:59.564+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:18:59.594 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:18:59.588+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:18:59.675 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:18:59.670+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:18:59.935 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:59.928+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:18:59.936 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:18:59.931+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:19:00.335 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:19:00.330+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:19:00.432 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:00.425+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:19:00.433 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:00.428+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:00.522 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:19:00.516+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:19:00.591 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:19:00.586+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:19:00.618 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:19:00.613+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:19:00.629 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:19:00.624+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:19:00.938 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:19:00.931+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:19:00.940 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:19:00.934+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:19:01.354 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:19:01.348+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.326325+0000 front 2019-11-27T19:17:27.868348+0000 (oldest deadline 2019-11-27T19:18:09.967660+0000) 2019-11-27T19:19:01.432 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:01.425+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:23.729729+0000 front 2019-11-27T19:17:26.310518+0000 (oldest deadline 2019-11-27T19:18:08.993324+0000) 2019-11-27T19:19:01.434 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:01.428+0000 1694c700 -1 osd.7 206 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:01.513 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:19:01.508+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:27.674101+0000 front 2019-11-27T19:17:27.379786+0000 (oldest deadline 2019-11-27T19:18:11.204142+0000) 2019-11-27T19:19:01.594 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:19:01.589+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:19:01.641 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:19:01.634+0000 1694c700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:26.310061+0000 front 2019-11-27T19:17:25.612974+0000 (oldest deadline 2019-11-27T19:18:09.387360+0000) 2019-11-27T19:19:01.659 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:19:01.651+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:29.327305+0000 front 2019-11-27T19:17:20.919945+0000 (oldest deadline 2019-11-27T19:18:07.811145+0000) 2019-11-27T19:19:01.990 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:19:01.983+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:17:48.591481+0000 (oldest deadline 2019-11-27T19:18:28.591481+0000) 2019-11-27T19:19:01.991 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:19:01.986+0000 1694c700 -1 osd.1 206 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:19:02.198 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:19:02.193+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 49sec e205 v205) 2019-11-27T19:19:02.577 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:19:02.572+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:17:28.234294+0000 front 2019-11-27T19:17:24.621628+0000 (oldest deadline 2019-11-27T19:18:08.122761+0000) 2019-11-27T19:19:02.693 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:02.526+0000 1694c700 -1 osd.7 207 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:03.283 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:19:03.182+0000 1694c700 -1 osd.1 207 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:109610 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e203) 2019-11-27T19:19:03.608 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:03.586+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:04.630 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:04.625+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:05.614 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:05.609+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:06.620 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:06.615+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:07.612 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:07.607+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:08.647 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:08.642+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:09.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:09.646+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:10.683 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:10.677+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:11.656 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:11.651+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:12.696 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:12.690+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:13.671 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:13.666+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:14.694 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:14.688+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:15.684 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:15.678+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:16.703 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:16.696+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:17.682 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:17.675+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:18.660 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:18.654+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:19.641 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:19.636+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:20.641 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:20.635+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:21.671 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:21.667+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:22.729 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:22.723+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:23.714 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:23.706+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:24.696 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:24.690+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:25.737 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:19:25.731+0000 1694c700 -1 osd.7 208 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:110875 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5427256320 gen 1] snapc 0=[] ondisk+write+known_if_redirected e201) 2019-11-27T19:19:26.958 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:19:26.918+0000 20e22700 -1 RGWWatcher::handle_error cookie 5427256320 err (107) Transport endpoint is not connected 2019-11-27T19:19:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-11-27T19:19:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-11-27T19:19:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-11-27T19:19:48.556 INFO:teuthology.orchestra.run.smithi005.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T19:19:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:testDeleteThen404s (test.functional.tests.TestFile) ... ok 2019-11-27T19:19:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:testEtagResponse (test.functional.tests.TestFile) ... ok 2019-11-27T19:19:56.091 INFO:teuthology.orchestra.run.smithi005.stderr:testEtagWayoff (test.functional.tests.TestFile) ... ok 2019-11-27T19:20:07.540 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:25:41.601 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.563 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:25:41.624 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.589 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:25:41.651 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.593 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:25:41.655 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.604 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:25:41.613 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.610 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:25:41.620 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.725 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:25:41.786 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.786 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:25:41.795 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:07.831 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:25:41.893 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:33.264 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:33.258+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:33.299 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:33.292+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:33.491 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:33.486+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:34.239 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:34.232+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:34.281 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:34.275+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:34.481 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:34.475+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:35.091 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:35.086+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:35.229 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:35.223+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:35.333 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:35.326+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:35.478 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:35.471+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:35.659 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:35.654+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:36.087 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:36.081+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:36.258 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:36.249+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:36.336 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:36.329+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:36.356 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:36.351+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:36.526 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:36.518+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:36.656 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:36.650+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:37.083 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:37.074+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:37.240 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:37.234+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:37.348 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:37.341+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:37.389 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:37.382+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:37.518 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:37.513+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:37.692 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:37.688+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:38.036 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:38.029+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:38.238 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:38.231+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:38.345 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:38.338+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:38.358 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:38.351+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:38.489 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:38.482+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:38.649 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:38.643+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:38.672 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:38.666+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:39.003 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:38.997+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:39.227 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:39.217+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:39.348 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:39.340+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:39.366 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:39.361+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:39.511 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:39.507+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:39.680 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:39.674+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:39.702 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:39.697+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:39.988 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:39.981+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:40.247 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:40.240+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:40.350 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:40.344+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:40.356 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:40.350+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:40.539 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:40.533+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:40.662 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:40.657+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:40.726 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:40.719+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:40.969 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:40.963+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:41.300 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:41.293+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:41.315 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:41.309+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:41.402 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:41.395+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:41.515 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:41.508+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:41.691 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:41.685+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:41.699 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:41.694+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:41.998 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:41.993+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:42.290 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:42.283+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:42.346 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:42.340+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:42.363 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:42.354+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:42.420 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:42.414+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:42.513 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:42.508+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:42.653 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:42.647+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:42.671 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:42.665+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:42.982 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:42.976+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:43.326 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:43.320+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:43.329 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:43.325+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:43.341 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:43.335+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:43.460 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:43.453+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:43.538 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:43.532+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:43.667 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:43.661+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:43.682 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:43.676+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:43.991 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:43.985+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:44.337 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:44.331+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:44.363 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:44.356+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:44.363 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:44.359+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:44.504 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:44.498+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:44.550 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:44.545+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:44.703 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:44.698+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:44.708 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:44.702+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:44.996 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:44.990+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:45.296 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:45.290+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:45.354 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:45.347+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:45.355 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:45.350+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:45.555 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:45.549+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:45.579 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:45.573+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:45.683 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:45.678+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:45.760 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:45.754+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:45.989 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:45.984+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:46.304 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:46.298+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:46.336 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:46.330+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:46.340 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:46.335+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:46.536 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:46.531+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:46.577 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:46.571+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:46.651 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:46.646+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:46.795 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:46.789+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:47.010 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:47.004+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:47.356 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:47.349+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:47.362 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:47.356+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:47.366 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:47.361+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:47.593 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:47.586+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:47.616 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:47.610+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:47.673 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:47.668+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:47.776 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:47.770+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:48.038 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:48.033+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:48.358 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:48.351+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:48.359 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:48.354+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:48.378 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:48.372+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:48.601 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:48.595+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:48.637 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:48.631+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:48.707 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:48.703+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:48.774 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:20:48.764+0000 1694c700 -1 osd.6 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.447495+0000 front 2019-11-27T19:19:52.423670+0000 (oldest deadline 2019-11-27T19:20:37.867067+0000) 2019-11-27T19:20:49.074 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:49.069+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:49.337 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:49.331+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:49.338 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:49.333+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:49.408 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:49.402+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:49.584 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:49.578+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:49.635 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:49.629+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:49.709 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:49.704+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:50.035 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:50.029+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:50.381 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:50.373+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:50.385 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:50.376+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:50.442 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:50.436+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:50.604 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:50.597+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:50.614 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:50.608+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:50.693 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:50.687+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:51.023 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:51.015+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:51.340 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:51.334+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:51.343 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:51.339+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:51.474 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:51.467+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:51.615 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:51.609+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:51.645 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:51.639+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:51.717 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:51.711+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:52.010 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:52.004+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:52.391 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:52.386+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:52.394 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:52.390+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:52.505 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:52.499+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:52.625 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:52.619+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:52.690 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:52.683+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:52.697 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:52.690+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:52.974 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:52.967+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:53.361 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:53.355+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:53.365 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:53.360+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:53.502 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:53.494+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:53.638 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:53.631+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:53.648 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:53.641+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:53.665 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:53.658+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:53.952 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:53.945+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:54.355 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:54.348+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:54.358 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:54.353+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:54.493 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:54.486+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:54.618 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:54.612+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:54.635 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:54.628+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:54.651 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:54.645+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:55.006 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:54.999+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:55.316 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:55.309+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:55.319 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:55.314+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:55.522 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:55.516+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:55.597 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:55.590+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:55.632 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:55.625+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:55.670 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:55.665+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:56.059 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:56.052+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:56.326 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:56.319+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:56.330 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:56.324+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:56.547 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:56.540+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:56.580 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:56.575+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:56.636 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:56.630+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:56.683 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:56.674+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:57.023 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:57.016+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:57.286 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:57.279+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:57.286 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:57.281+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:57.533 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:57.527+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:57.571 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:57.565+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:57.682 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:57.675+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:57.685 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:57.678+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:58.033 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:58.026+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:58.252 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:58.246+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:58.254 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:58.250+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:58.549 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:58.543+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:58.558 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:58.553+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:58.697 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:58.692+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:58.715 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:58.709+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:20:59.039 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:20:59.033+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:20:59.275 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:59.268+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:20:59.275 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:20:59.271+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:20:59.505 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:20:59.499+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:20:59.541 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:20:59.536+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:20:59.701 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:20:59.695+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:20:59.756 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:20:59.750+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:00.055 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:00.050+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:00.232 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:00.226+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:00.235 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:00.230+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:00.530 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:21:00.523+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:21:00.595 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:00.589+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:00.668 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:00.662+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:00.771 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:00.765+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:01.062 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:01.057+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:01.223 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:01.217+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:01.227 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:01.222+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:01.560 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:21:01.553+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:21:01.613 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:01.606+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:01.719 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:01.714+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:01.798 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:01.792+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:02.089 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:02.084+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:02.240 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:02.233+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:02.241 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:02.236+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:02.555 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:21:02.548+0000 1694c700 -1 osd.7 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:47.631765+0000 front 2019-11-27T19:19:47.629818+0000 (oldest deadline 2019-11-27T19:20:32.715220+0000) 2019-11-27T19:21:02.574 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:02.570+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:02.709 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:02.703+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:02.809 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:02.802+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:03.064 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:03.058+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:03.215 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:03.208+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:03.216 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:03.211+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:03.551 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:03.547+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:03.673 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:03.668+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:03.787 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:03.781+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:04.080 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:04.074+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:04.173 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:04.166+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:04.173 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:04.168+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:04.544 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:04.540+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:04.646 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:04.641+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:04.744 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:04.739+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:05.082 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:05.076+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:05.187 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:05.179+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:05.187 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:05.182+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:05.577 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:05.570+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:05.651 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:05.646+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:05.709 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:05.702+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:06.080 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:06.074+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:06.186 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:06.179+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:06.187 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:06.182+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:06.537 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:06.532+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:06.627 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:06.622+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:06.675 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:06.668+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:07.070 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:07.063+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:07.146 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:07.139+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:07.147 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:07.142+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:07.561 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:07.554+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:07.645 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:07.640+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:07.680 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:07.673+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:07.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:21:07.737+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 43sec e211 v211) 2019-11-27T19:21:08.026 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:08.020+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:08.142 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:08.135+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:08.143 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:08.138+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:08.589 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:08.583+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:08.628 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:08.623+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:08.645 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:08.638+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:09.035 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:09.030+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:09.117 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:09.110+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:09.118 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:09.113+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:09.617 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:09.612+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:09.633 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:09.627+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:09.689 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:09.682+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:10.038 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:10.034+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:10.148 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:10.142+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:10.151 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:10.147+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:10.593 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:10.587+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:10.659 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:10.654+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:10.692 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:10.685+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:11.051 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:11.045+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:11.141 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:11.135+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:11.144 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:11.140+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:11.548 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:11.542+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:11.633 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:11.628+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:11.725 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:11.719+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:12.090 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:12.085+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:12.178 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:12.172+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:12.185 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:12.180+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:12.550 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:21:12.545+0000 1694c700 -1 osd.2 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.615293+0000 front 2019-11-27T19:19:51.616096+0000 (oldest deadline 2019-11-27T19:20:35.187580+0000) 2019-11-27T19:21:12.617 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:21:12.611+0000 1694c700 -1 osd.0 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.176579+0000 front 2019-11-27T19:19:51.183461+0000 (oldest deadline 2019-11-27T19:20:32.888747+0000) 2019-11-27T19:21:12.697 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:21:12.691+0000 1694c700 -1 osd.4 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.617881+0000 front 2019-11-27T19:19:51.590581+0000 (oldest deadline 2019-11-27T19:20:35.861969+0000) 2019-11-27T19:21:12.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:21:12.805+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 43sec e211 v211) 2019-11-27T19:21:13.083 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:21:13.078+0000 1694c700 -1 osd.3 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:51.614305+0000 front 2019-11-27T19:19:51.458979+0000 (oldest deadline 2019-11-27T19:20:34.900572+0000) 2019-11-27T19:21:13.184 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:13.179+0000 1694c700 -1 osd.5 211 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:19:52.549145+0000 front 2019-11-27T19:19:49.172415+0000 (oldest deadline 2019-11-27T19:20:32.471402+0000) 2019-11-27T19:21:13.184 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:13.180+0000 1694c700 -1 osd.5 211 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:14.398 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:14.328+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:15.318 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:15.314+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:16.342 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:16.337+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:17.304 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:17.299+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:18.296 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:18.292+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:19.270 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:19.265+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:20.227 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:20.223+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:21.243 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:21.239+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:22.238 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:22.234+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:23.275 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:23.270+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:24.304 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:24.299+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:25.339 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:25.335+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:26.351 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:26.346+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:27.402 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:27.397+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:28.419 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:28.414+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:29.391 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:29.386+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:30.403 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:30.398+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:31.428 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:31.424+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:32.408 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:32.403+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:33.456 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:33.451+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:34.491 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:34.486+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:35.463 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:35.459+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:36.477 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:36.473+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:37.532 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:37.527+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:38.268 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:27:12.329 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.276 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:27:12.337 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.289 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:27:12.351 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.294 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:27:12.303 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.294 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:27:12.356 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.299 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:27:12.308 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.393 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:27:12.455 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.455 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:27:12.516 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.478 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:27:12.487 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:21:38.570 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:38.566+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:39.529 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:39.525+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:40.524 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:21:40.520+0000 1694c700 -1 osd.5 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111221 2.d 2:b36647d2:::dc4084cb-262b-4d5b-9664-fa175bfdb24a.4364.650_a8e08625f6ac4e7b9dae1f972ea80615:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~24780 in=24780b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (58) in=78b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-27T19:21:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:testFileCreate (test.functional.tests.TestFile) ... ok 2019-11-27T19:22:08.179 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:08.172+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:09.177 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:09.171+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:10.209 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:10.203+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:10.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:10.985+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:10.991 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:10.986+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:11.047 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:11.041+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:11.164 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:11.159+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:11.989 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:11.984+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:11.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:11.986+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:12.033 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:12.028+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:12.170 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:12.165+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:12.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:12.948+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:12.956 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:12.952+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:13.033 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:13.027+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:13.127 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:13.123+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:13.248 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:13.242+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:13.604 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:13.598+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:13.937 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:13.931+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:13.937 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:13.933+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:14.024 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:14.018+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:14.164 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:14.159+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:14.264 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:14.259+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:14.571 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:14.565+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:14.950 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:14.943+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:14.950 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:14.945+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:15.044 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:15.039+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:15.169 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:15.163+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:15.237 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:15.232+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:15.582 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:15.576+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:15.952 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:15.946+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:15.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:15.985+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:15.994 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:15.989+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:16.049 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:16.039+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:16.212 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:16.207+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:16.214 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:16.209+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:16.630 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:16.624+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:16.976 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:16.971+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:17.006 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:17.001+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:17.020 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:17.014+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:17.021 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:17.016+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:17.213 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:17.208+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:17.241 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:17.236+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:17.673 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:17.667+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:17.955 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:17.949+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:17.965 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:17.959+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:18.033 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:18.028+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:18.036 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:18.031+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:18.192 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:18.187+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:18.291 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:18.285+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:18.666 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:18.660+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:18.916 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:18.911+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:18.952 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:18.947+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:18.999 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:18.994+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:19.000 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:18.995+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:19.248 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:19.242+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:19.320 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:19.314+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:19.671 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:19.666+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:19.876 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:19.871+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:19.970 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:19.965+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:19.971 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:19.966+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:19.996 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:19.991+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:20.234 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:20.227+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:20.362 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:20.356+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:20.711 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:20.706+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:20.857 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:20.850+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:20.948 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:20.942+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:20.948 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:20.943+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:21.007 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:21.002+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:21.281 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:21.276+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:21.355 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:21.350+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:21.741 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:21.735+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:21.823 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:21.817+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:21.969 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:21.963+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:21.970 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:21.965+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:22.038 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:22.033+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:22.244 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:22.239+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:22.390 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:22.384+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:22.790 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:22.784+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:22.811 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:22.805+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:22.941 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:22.934+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:22.941 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:22.936+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:23.057 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:23.052+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:23.282 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:23.276+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:23.368 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:23.364+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:23.759 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:23.753+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:23.816 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:23.810+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:23.925 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:23.920+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:23.928 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:23.923+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:24.084 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:24.079+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:24.283 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:24.278+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:24.373 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:24.367+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:24.793 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:24.788+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:24.843 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:24.838+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:24.930 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:24.924+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:24.933 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:24.928+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:25.112 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:25.107+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:25.316 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:25.310+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:25.341 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:25.335+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:25.754 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:25.748+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:25.849 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:25.844+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:25.904 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:25.897+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:25.905 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:25.899+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:26.080 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:26.074+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:26.271 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:26.265+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:26.373 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:26.367+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:26.806 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:26.801+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:26.816 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:26.810+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:26.884 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:26.879+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:26.886 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:26.882+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:27.067 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:27.061+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:27.275 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:27.270+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:27.377 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:27.372+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:27.783 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:27.776+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:27.861 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:27.855+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:27.906 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:27.901+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:27.909 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:27.905+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:28.044 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:28.038+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:28.267 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:28.260+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:28.407 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:28.401+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:28.738 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:28.733+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:28.855 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:28.847+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:28.882 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:28.877+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:28.883 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:28.878+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:29.083 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:29.077+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:29.270 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:29.264+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:29.421 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:29.414+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:29.775 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:29.769+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:29.846 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:29.840+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:29.847 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:29.842+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:29.847 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:29.842+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:30.082 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:30.078+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:30.232 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:30.226+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:30.415 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:30.408+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:30.804 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:30.798+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:30.865 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:30.859+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:30.865 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:30.861+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:30.868 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:30.864+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:31.051 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:31.046+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:31.266 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:31.260+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:31.443 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:31.436+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:31.768 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:31.762+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:31.854 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:31.848+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:31.857 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:31.851+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:31.896 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:31.890+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:32.013 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:32.006+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:32.223 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:32.216+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:32.447 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:32.440+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:32.771 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:32.764+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:32.785 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:32.781+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:32.834 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:32.827+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:32.835 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:32.829+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:32.938 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:32.926+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:32.973 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:32.968+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:33.249 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:33.244+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:33.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:33.399+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:33.748 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:33.742+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:33.780 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:33.772+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:33.782 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:33.776+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:33.848 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:33.840+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:33.849 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:33.843+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:33.931 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:33.926+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:33.936 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:33.927+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:34.220 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:34.214+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:34.451 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:34.446+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:34.765 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:34.759+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:34.766 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:34.760+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:34.781 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:34.774+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:34.824 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:34.817+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:34.826 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:34.818+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:34.927 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:34.923+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:34.957 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:34.950+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:35.260 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:35.255+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:35.459 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:35.454+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:35.778 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:35.770+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:35.780 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:35.774+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:35.784 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:35.778+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:35.830 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:35.823+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:35.831 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:35.826+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:35.963 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:35.957+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:35.999 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:35.994+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:36.311 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:36.305+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:36.464 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:36.458+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:36.739 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:36.733+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:36.741 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:36.735+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:36.808 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:36.803+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:36.881 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:36.874+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:36.881 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:36.876+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:36.936 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:36.931+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:37.043 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:37.039+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:37.315 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:37.309+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:37.449 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:37.443+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:37.725 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:37.718+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:37.725 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:37.721+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:37.848 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:37.842+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:37.849 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:37.844+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:37.850 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:37.845+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:37.908 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:37.903+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:38.082 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:38.076+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:38.331 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:38.327+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:38.421 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:38.417+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:38.691 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:38.685+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:38.692 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:38.688+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:38.841 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:38.835+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:38.883 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:38.877+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:38.885 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:38.879+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:38.886 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:38.881+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:39.086 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:39.080+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:39.314 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:39.308+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:39.400 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:39.395+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:39.745 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:39.739+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:39.751 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:39.746+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:39.864 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:39.859+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:39.865 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:39.859+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:39.866 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:39.862+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:39.884 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:39.880+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:40.087 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:40.081+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:40.321 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:40.315+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:40.429 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:40.422+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:40.754 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:40.749+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:40.755 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:40.751+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:40.822 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:40.817+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:40.866 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:40.860+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:40.913 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:40.908+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:40.917 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:40.912+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:41.104 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:41.097+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:41.277 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:41.272+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:41.474 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:41.469+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:41.743 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:41.738+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:41.748 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:41.743+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:41.830 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:41.824+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:41.851 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:41.843+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:41.930 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:41.924+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:41.931 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:41.926+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:42.093 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:42.087+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:42.290 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:42.284+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:42.455 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:42.449+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:42.763 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:42.757+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:42.764 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:42.759+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:42.833 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:42.827+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:42.855 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:42.849+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:42.906 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:42.900+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:42.907 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:42.901+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:43.070 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:22:43.065+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e217 v217) 2019-11-27T19:22:43.114 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:43.107+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:43.310 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:43.305+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:43.441 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:43.434+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:43.737 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:43.730+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:43.739 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:43.733+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:43.830 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:43.824+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:43.870 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:43.864+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:43.893 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:43.888+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:43.897 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:43.892+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:44.142 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:44.136+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:44.270 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:44.265+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:44.447 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:44.441+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:44.706 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:44.700+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:44.713 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:44.708+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:44.796 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:44.790+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:44.854 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:44.849+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:44.948 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:44.942+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:44.949 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:44.943+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:45.145 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:45.140+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:45.263 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:45.257+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:45.441 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:45.435+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:45.719 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:45.712+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:45.721 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:45.715+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:45.796 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:45.791+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:45.876 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:45.868+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:45.968 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:45.961+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:45.969 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:45.964+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:46.181 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:46.175+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:46.316 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:46.310+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:46.469 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:46.463+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:46.769 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:46.764+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:46.775 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:46.768+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:46.798 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:46.793+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:46.896 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:46.890+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:47.007 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:47.002+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:47.012 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:47.007+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:47.185 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:47.180+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:47.337 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:47.330+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:47.475 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:47.469+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:47.753 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:47.747+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:47.757 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:47.752+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:47.848 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:47.839+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:47.911 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:47.906+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:48.031 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:48.024+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:48.032 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:48.026+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:48.098 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:22:48.087+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e217 v217) 2019-11-27T19:22:48.155 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:48.149+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:48.365 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:48.360+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:48.482 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:48.477+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:48.811 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:48.804+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:48.812 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:48.807+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:48.828 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:48.823+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:48.916 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:48.911+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:49.049 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:49.042+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:49.050 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:49.045+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:49.203 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:49.197+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:49.324 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:49.320+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:49.445 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:49.438+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:49.834 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:49.827+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:49.835 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:49.830+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:49.861 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:49.856+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:49.879 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:49.875+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:50.089 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:50.074+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:50.089 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:50.079+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:50.237 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:50.231+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:50.292 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:50.286+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:50.422 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:50.415+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:50.807 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:50.802+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:50.811 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:50.806+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:50.866 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:50.859+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:50.889 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:50.883+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:51.066 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:51.059+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:51.067 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:51.062+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:51.240 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:51.234+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:51.273 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:51.268+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:51.472 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:51.467+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:51.813 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:51.807+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:51.813 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:51.809+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:51.872 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:51.868+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:51.918 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:51.913+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:52.035 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:52.028+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:52.036 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:52.030+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:52.232 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:52.226+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:52.242 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:52.237+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:52.510 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:52.504+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:52.797 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:52.789+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:52.798 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:52.793+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:52.827 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:52.822+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:52.922 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:52.916+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:53.036 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:53.029+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:53.037 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:53.032+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:53.111 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:22:53.107+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e217 v217) 2019-11-27T19:22:53.221 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:53.216+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:53.278 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:53.273+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:53.541 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:53.536+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:53.850 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:53.843+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:53.852 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:53.846+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:53.879 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:53.874+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:53.904 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:53.899+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:54.006 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:54.001+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:54.010 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:54.005+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:54.247 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:54.241+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:54.298 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:54.292+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:54.538 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:54.533+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:54.863 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:54.856+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:54.864 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:54.859+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:54.884 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:54.874+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:54.897 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:54.892+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:54.978 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:54.972+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:54.979 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:54.974+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:55.283 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:55.277+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:55.285 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:55.280+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:55.593 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:55.587+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:55.834 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:55.828+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:55.899 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:55.892+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:55.900 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:55.894+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:55.906 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:55.900+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:56.024 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:56.019+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:56.028 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:56.023+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:56.309 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:56.304+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:56.331 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:56.325+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:56.636 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:56.630+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:56.791 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:56.786+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:56.921 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:56.915+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:56.951 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:56.946+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:56.956 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:56.951+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:56.986 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:56.981+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:56.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:56.985+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:57.345 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:57.339+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:57.385 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:57.380+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:57.622 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:57.617+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:57.790 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:57.785+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:57.931 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:57.923+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:57.934 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:57.928+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:57.945 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:57.939+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:57.976 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:57.970+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:57.977 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:57.972+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:58.137 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:22:58.127+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e217 v217) 2019-11-27T19:22:58.376 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:58.371+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:58.410 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:58.405+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:58.641 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:58.635+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:58.776 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:58.771+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:58.951 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:58.944+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:58.952 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:58.946+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:58.976 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:58.971+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:22:58.977 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:58.970+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:22:58.977 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:22:58.973+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:22:59.371 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:22:59.364+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:22:59.446 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:22:59.441+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:22:59.693 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:22:59.687+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:22:59.828 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:22:59.822+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:22:59.937 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:59.932+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:22:59.941 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:22:59.936+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:22:59.959 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:22:59.954+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:00.021 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:00.013+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:00.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:00.016+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:00.366 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:00.360+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:00.495 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:00.490+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:00.660 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:00.654+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:00.814 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:00.809+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:00.909 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:00.902+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:00.911 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:00.905+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:00.958 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:00.952+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:01.021 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:01.014+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:01.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:01.017+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:01.371 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:01.366+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:01.533 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:01.528+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:01.709 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:01.704+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:01.824 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:01.818+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:01.886 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:01.878+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:01.887 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:01.881+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:02.004 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:01.999+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:02.032 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:02.027+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:02.038 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:02.032+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:02.385 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:02.379+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:02.549 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:02.544+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:02.679 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:02.674+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:02.844 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:02.838+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:02.881 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:02.876+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:02.885 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:02.880+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:02.980 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:02.975+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:03.045 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:03.039+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:03.047 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:03.041+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:03.151 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:23:03.147+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e217 v217) 2019-11-27T19:23:03.423 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:03.417+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:03.589 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:03.583+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:03.715 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:03.709+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:03.854 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:03.848+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:03.855 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:03.850+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:03.881 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:03.875+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:03.951 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:03.946+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:04.024 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:04.019+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:04.029 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:04.024+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:04.430 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:04.425+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:04.621 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:04.616+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:04.760 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:04.754+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:04.889 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:04.881+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:04.893 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:04.887+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:04.895 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:04.891+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:04.943 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:04.937+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:05.040 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:05.034+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:05.045 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:05.040+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:05.462 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:05.457+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:05.617 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:05.611+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:05.789 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:05.784+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:05.893 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:05.884+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:05.895 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:05.888+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:05.913 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:05.908+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:05.982 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:05.976+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:06.083 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:06.078+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:06.089 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:06.084+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:06.492 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:06.486+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:06.586 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:06.581+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:06.797 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:06.791+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:06.870 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:06.865+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:06.946 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:06.940+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:06.950 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:06.945+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:06.984 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:06.979+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:07.051 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:07.044+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:07.052 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:07.047+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:07.461 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:23:07.456+0000 1694c700 -1 osd.6 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.903282+0000 front 2019-11-27T19:21:27.885496+0000 (oldest deadline 2019-11-27T19:22:10.449825+0000) 2019-11-27T19:23:07.605 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:07.600+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:07.822 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:23:07.816+0000 1694c700 -1 osd.3 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.168858+0000 front 2019-11-27T19:21:28.207557+0000 (oldest deadline 2019-11-27T19:22:12.499488+0000) 2019-11-27T19:23:07.867 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:23:07.860+0000 1694c700 -1 osd.2 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.904075+0000 front 2019-11-27T19:21:27.902378+0000 (oldest deadline 2019-11-27T19:22:15.266601+0000) 2019-11-27T19:23:07.947 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:23:07.941+0000 1694c700 -1 osd.5 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:28.169293+0000 front 2019-11-27T19:21:27.904620+0000 (oldest deadline 2019-11-27T19:22:13.516344+0000) 2019-11-27T19:23:07.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:07.946+0000 1694c700 -1 osd.7 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.875315+0000 front 2019-11-27T19:21:28.779401+0000 (oldest deadline 2019-11-27T19:22:10.026150+0000) 2019-11-27T19:23:07.955 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:07.949+0000 1694c700 -1 osd.7 217 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:08.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:08.015+0000 1694c700 -1 osd.1 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 ever on either front or back, first ping sent 2019-11-27T19:21:53.747306+0000 (oldest deadline 2019-11-27T19:22:33.747306+0000) 2019-11-27T19:23:08.024 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:23:08.017+0000 1694c700 -1 osd.1 217 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4364.0:91324 7.d 7.8e4c711d (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-27T19:23:08.217 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:23:08.212+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 40sec e217 v217) 2019-11-27T19:23:08.625 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:23:08.621+0000 1694c700 -1 osd.0 217 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:21:27.854506+0000 front 2019-11-27T19:21:28.259231+0000 (oldest deadline 2019-11-27T19:22:08.011924+0000) 2019-11-27T19:23:08.920 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:08.914+0000 1694c700 -1 osd.7 218 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:10.011 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:09.988+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:10.981 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:10.975+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:11.946 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:11.941+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:12.927 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:12.922+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:13.960 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:13.956+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:14.940 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:14.935+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:15.982 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:15.978+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:16.962 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:16.957+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:18.008 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:18.002+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:19.050 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:19.045+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:20.022 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:20.016+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:20.979 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:20.973+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:22.000 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:21.994+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:22.989 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:22.982+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:23.992 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:23.985+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:25.032 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:25.026+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:25.666 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:23:25.517+0000 1694c700 -1 osd.4 219 get_health_metrics reporting 1 slow ops, oldest is osd_repop(osd.7.0:9054 5.5 e217/210 5:a93a5511:::notify.2:head v 217'172) 2019-11-27T19:23:26.029 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:23:26.025+0000 1694c700 -1 osd.7 219 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:111371 5.5 5:a93a5511:::notify.2:head [watch ping cookie 5413644816 gen 1] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-27T19:23:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:testGetContentType (test.functional.tests.TestFile) ... ok 2019-11-27T19:23:26.861 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:23:26.824+0000 20e22700 -1 RGWWatcher::handle_error cookie 5413644816 err (107) Transport endpoint is not connected 2019-11-27T19:23:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:testGetOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T19:23:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:testHead (test.functional.tests.TestFile) ... ok 2019-11-27T19:23:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:testHeadOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T19:23:59.945 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:23:59.940+0000 1694c700 -1 osd.4 223 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111580 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 89] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-27T19:24:31.092 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:31.086+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:31.588 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:31.582+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:31.899 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:31.893+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:32.073 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:32.066+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:32.142 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:32.135+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:32.509 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:32.503+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:32.602 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:32.592+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:32.927 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:32.922+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:33.108 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:33.103+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:33.166 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:33.161+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:33.533 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:33.527+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:33.574 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:33.569+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:33.927 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:33.920+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:34.112 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:34.105+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:34.197 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:34.191+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:34.504 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:34.498+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:34.606 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:34.600+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:34.964 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:34.956+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:35.158 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:35.151+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:35.219 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:35.212+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:35.518 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:35.506+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:35.579 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:35.573+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:35.615 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:35.608+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:35.988 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:35.982+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:36.161 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:36.154+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:36.246 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:36.240+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:36.414 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:36.408+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:36.524 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:36.518+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:36.575 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:36.567+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:36.613 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:36.607+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:36.975 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:36.969+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:37.210 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:37.203+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:37.214 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:37.209+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:37.377 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:37.372+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:37.535 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:37.528+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:37.601 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:37.595+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:37.619 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:37.611+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:37.967 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:37.963+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:38.172 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:38.166+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:38.225 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:38.218+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:38.390 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:38.384+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:38.555 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:38.549+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:38.570 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:38.564+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:38.658 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:38.651+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:38.945 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:38.940+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:39.173 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:39.166+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:39.245 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:39.239+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:39.364 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:39.359+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:39.517 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:39.511+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:39.536 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:39.531+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:39.671 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:39.665+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:39.932 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:39.926+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:40.188 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:40.182+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:40.218 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:40.211+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:40.348 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:40.342+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:40.497 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:40.490+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:40.567 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:40.560+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:40.644 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:40.637+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:40.976 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:40.969+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:41.173 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:41.166+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:41.199 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:41.193+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:41.400 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:41.393+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:41.482 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:41.477+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:41.579 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:41.574+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:41.696 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:41.689+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:41.953 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:41.948+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:42.219 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:42.212+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:42.238 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:42.232+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:42.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:42.400+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:42.440 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:42.434+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:42.613 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:42.607+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:42.666 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:42.659+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:42.997 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:42.993+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:43.192 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:43.186+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:43.225 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:43.218+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:43.425 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:43.420+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:43.464 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:43.454+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:43.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:43.644+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:43.706 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:43.700+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:43.972 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:43.965+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:44.206 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:44.200+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:44.209 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:44.200+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:44.450 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:44.445+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:44.509 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:44.503+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:44.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:44.644+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:44.702 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:44.695+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:44.966 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:44.960+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:45.179 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:45.172+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:45.249 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:45.243+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:45.435 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:45.429+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:testMetadataOnPost (test.functional.tests.TestFile) ... ok 2019-11-27T19:24:45.524 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:45.519+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:45.683 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:45.677+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:45.903 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:45.877+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:45.956 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:45.951+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:46.195 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:46.189+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:46.217 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:46.210+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:46.452 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:46.446+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:46.527 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:46.521+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:46.735 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:46.728+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:46.908 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:46.901+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:47.006 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:47.000+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:47.183 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:47.177+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:47.241 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:47.234+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:47.546 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:47.540+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:47.568 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:47.543+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:47.756 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:47.750+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:47.949 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:47.943+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:48.046 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:48.040+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:48.194 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:48.188+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:48.241 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:48.235+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:48.503 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:48.498+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:48.534 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:48.527+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:48.777 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:48.771+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:49.098 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:49.092+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:49.122 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:49.115+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:49.190 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:49.184+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:49.227 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:49.222+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:49.508 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:49.503+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:49.537 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:49.532+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:49.752 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:49.745+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:50.143 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:50.137+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:50.144 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:50.139+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:50.211 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:50.203+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:50.266 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:50.259+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:50.471 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:50.465+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:50.555 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:50.550+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:50.758 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:50.753+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:51.104 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:51.098+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:51.136 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:51.129+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:51.227 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:51.220+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:51.271 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:51.265+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:51.516 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:51.510+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:51.540 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:51.535+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:51.781 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:51.775+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:52.080 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:52.073+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:52.138 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:52.132+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:52.244 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:52.237+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:52.309 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:52.303+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:52.534 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:52.528+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:52.539 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:52.534+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:52.779 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:52.773+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:53.100 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:53.093+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:53.125 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:53.119+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:53.218 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:53.211+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:53.345 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:53.338+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:53.506 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:53.500+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:53.581 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:53.577+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:53.762 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:53.756+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:54.135 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:54.130+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:54.147 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:54.140+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:54.259 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:54.252+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:54.382 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:54.377+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:54.525 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:54.518+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:54.593 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:54.586+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:54.769 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:54.762+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:55.105 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:55.097+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:55.110 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:55.105+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:55.261 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:55.254+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:55.367 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:55.360+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:55.528 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:55.522+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:55.632 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:55.626+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:55.815 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:55.809+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:56.089 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:56.081+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:56.266 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:56.261+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:56.270 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:56.264+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:56.322 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:56.316+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:56.525 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:56.518+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:56.674 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:56.668+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:56.807 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:56.801+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:57.066 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:57.060+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:57.280 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:57.275+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:57.299 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:57.293+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:57.333 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:57.327+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:57.511 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:57.504+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:57.669 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:57.662+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:57.839 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:57.833+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:58.113 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:58.106+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:58.271 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:58.264+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:58.302 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:58.296+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:58.326 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:58.321+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:58.500 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:58.493+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:58.679 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:58.673+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:58.881 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:58.874+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:24:59.133 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:24:59.126+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:24:59.251 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:24:59.244+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:24:59.282 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:24:59.276+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:24:59.295 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:24:59.288+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:24:59.482 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:24:59.477+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:24:59.681 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:24:59.675+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:24:59.865 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:24:59.858+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:00.173 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:00.167+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:00.308 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:00.301+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:00.325 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:00.318+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:00.329 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:00.313+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:00.502 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:00.495+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:00.716 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:00.712+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:00.859 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:00.851+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:01.146 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:01.140+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:01.321 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:01.309+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:01.355 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:01.348+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:01.374 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:01.365+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:01.510 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:01.503+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:01.784 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:01.778+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:01.911 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:01.905+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:02.122 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:02.116+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:02.326 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:02.318+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:02.327 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:02.320+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:02.402 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:02.394+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:02.475 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:02.470+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:02.938 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:02.930+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:03.041 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:03.033+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:03.101 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:03.095+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:03.341 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:03.334+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:03.348 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:03.342+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:03.364 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:03.358+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:03.487 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:03.482+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:03.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:25:03.543+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 43sec e223 v223) 2019-11-27T19:25:03.959 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:03.953+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:04.033 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:04.027+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:04.121 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:04.116+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:04.344 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:04.338+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:04.417 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:04.411+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:04.458 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:04.454+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:04.472 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:04.466+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:04.961 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:04.954+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:05.076 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:05.070+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:05.168 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:05.163+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:05.369 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:05.364+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:05.423 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:05.416+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:05.449 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:05.444+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:05.510 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:05.504+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:05.918 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:05.912+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:06.097 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:06.092+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:06.187 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:06.181+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:06.357 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:06.350+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:06.382 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:06.376+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:06.440 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:06.433+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:06.680 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:06.668+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:06.974 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:06.968+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:07.058 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:07.053+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:07.208 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:07.203+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:07.326 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:07.320+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:07.407 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:07.400+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:07.451 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:07.446+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:07.672 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:07.665+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:07.985 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:07.979+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:08.040 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:08.035+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:08.188 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:08.183+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:08.338 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:08.332+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:08.453 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:08.446+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:08.455 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:08.450+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:08.571 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:25:08.563+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 43sec e223 v223) 2019-11-27T19:25:08.724 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:08.718+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:08.940 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:08.933+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:09.094 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:09.089+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:09.175 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:09.168+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:09.358 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:09.351+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:09.447 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:09.441+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:09.487 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:09.481+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:09.740 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:09.734+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:09.960 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:09.953+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:10.072 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:10.066+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:10.140 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:10.134+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:10.398 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:10.392+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:10.410 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:10.404+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:10.472 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:10.467+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:10.754 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:10.747+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:10.924 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:10.918+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:11.042 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:11.036+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:11.163 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:11.159+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:11.407 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:11.400+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:11.437 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:11.431+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:11.498 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:11.491+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:11.711 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:11.705+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:11.961 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:11.955+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:12.060 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:12.056+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:12.136 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:12.130+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:12.379 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:12.372+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:12.444 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:12.437+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:12.533 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:12.528+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:12.691 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:12.684+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:12.937 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:25:12.931+0000 1694c700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:46.413065+0000 front 2019-11-27T19:23:46.434136+0000 (oldest deadline 2019-11-27T19:24:32.185714+0000) 2019-11-27T19:25:13.093 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:25:13.087+0000 1694c700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.450339+0000 front 2019-11-27T19:23:50.158632+0000 (oldest deadline 2019-11-27T19:24:35.926424+0000) 2019-11-27T19:25:13.143 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:25:13.136+0000 1694c700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.530892+0000 front 2019-11-27T19:23:50.690172+0000 (oldest deadline 2019-11-27T19:24:31.594116+0000) 2019-11-27T19:25:13.396 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:13.389+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:13.435 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:25:13.428+0000 1694c700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.085425+0000 front 2019-11-27T19:23:50.450343+0000 (oldest deadline 2019-11-27T19:24:31.619933+0000) 2019-11-27T19:25:13.511 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:13.506+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:13.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:25:13.627+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.5:6806/10036,v1:172.21.15.5:6807/10036] for 43sec e223 v223) 2019-11-27T19:25:13.652 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:25:13.645+0000 1694c700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:45.749074+0000 front 2019-11-27T19:23:45.737597+0000 (oldest deadline 2019-11-27T19:24:30.997231+0000) 2019-11-27T19:25:14.419 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:25:14.412+0000 1694c700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:49.113595+0000 front 2019-11-27T19:23:49.106869+0000 (oldest deadline 2019-11-27T19:24:30.780604+0000) 2019-11-27T19:25:14.549 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:25:14.543+0000 1694c700 -1 osd.2 223 heartbeat_check: no reply from 172.21.15.5:6813 osd.1 since back 2019-11-27T19:23:50.444361+0000 front 2019-11-27T19:23:50.448753+0000 (oldest deadline 2019-11-27T19:24:35.185530+0000) 2019-11-27T19:25:22.095 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:30:56.156 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.105 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:30:56.167 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.116 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:30:56.177 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.118 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:30:56.127 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.125 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:30:56.186 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.142 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:30:56.151 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.384 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:30:56.446 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.395 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:30:56.456 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:22.441 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:30:56.449 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:testMetadataOnPut (test.functional.tests.TestFile) ... ok 2019-11-27T19:25:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:testNameLimit (test.functional.tests.TestFile) ... ok 2019-11-27T19:25:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:testNoContentLengthForPut (test.functional.tests.TestFile) ... ok 2019-11-27T19:25:45.761 INFO:teuthology.orchestra.run.smithi005.stderr:testPostOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T19:26:06.109 INFO:tasks.ceph.osd.1.smithi005.stderr:*** Caught signal (Aborted) ** 2019-11-27T19:26:06.109 INFO:tasks.ceph.osd.1.smithi005.stderr: in thread 36275700 thread_name:tp_osd_tp 2019-11-27T19:26:06.168 INFO:tasks.ceph.osd.1.smithi005.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T19:26:06.168 INFO:tasks.ceph.osd.1.smithi005.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 2: (_vgr20290ZU_libcZdsoZa___GI_mempcpy()+0x98) [0xa703ba8] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 3: (_IO_default_xsputn()+0x11c) [0xd189f8c] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 4: (_IO_vfprintf()+0x4a33) [0xd159fe3] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 5: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 6: (cls_log()+0xfa) [0x69b07a] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 7: (()+0x23201) [0x273f3201] 2019-11-27T19:26:06.169 INFO:tasks.ceph.osd.1.smithi005.stderr: 8: (()+0x15342) [0x273e5342] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 9: (()+0x65bc6e) [0x763c6e] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 10: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 11: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 12: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 13: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 14: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 15: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T19:26:06.170 INFO:tasks.ceph.osd.1.smithi005.stderr: 16: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T19:26:06.171 INFO:tasks.ceph.osd.1.smithi005.stderr: 17: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T19:26:06.171 INFO:tasks.ceph.osd.1.smithi005.stderr: 18: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T19:26:06.171 INFO:tasks.ceph.osd.1.smithi005.stderr: 19: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T19:26:06.171 INFO:tasks.ceph.osd.1.smithi005.stderr: 20: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T19:26:06.171 INFO:tasks.ceph.osd.1.smithi005.stderr: 21: (()+0x7e65) [0xc093e65] 2019-11-27T19:26:06.171 INFO:tasks.ceph.osd.1.smithi005.stderr: 22: (clone()+0x6d) [0xd20b88d] 2019-11-27T19:26:06.216 INFO:tasks.ceph.osd.1.smithi005.stderr:2019-11-27T19:26:06.208+0000 36275700 -1 *** Caught signal (Aborted) ** 2019-11-27T19:26:06.216 INFO:tasks.ceph.osd.1.smithi005.stderr: in thread 36275700 thread_name:tp_osd_tp 2019-11-27T19:26:06.216 INFO:tasks.ceph.osd.1.smithi005.stderr: 2019-11-27T19:26:06.216 INFO:tasks.ceph.osd.1.smithi005.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T19:26:06.216 INFO:tasks.ceph.osd.1.smithi005.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 2: (_vgr20290ZU_libcZdsoZa___GI_mempcpy()+0x98) [0xa703ba8] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 3: (_IO_default_xsputn()+0x11c) [0xd189f8c] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 4: (_IO_vfprintf()+0x4a33) [0xd159fe3] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 5: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 6: (cls_log()+0xfa) [0x69b07a] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 7: (()+0x23201) [0x273f3201] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 8: (()+0x15342) [0x273e5342] 2019-11-27T19:26:06.217 INFO:tasks.ceph.osd.1.smithi005.stderr: 9: (()+0x65bc6e) [0x763c6e] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 10: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 11: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 12: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 13: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 14: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 15: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T19:26:06.218 INFO:tasks.ceph.osd.1.smithi005.stderr: 16: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 17: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 18: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 19: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 20: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 21: (()+0x7e65) [0xc093e65] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 22: (clone()+0x6d) [0xd20b88d] 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T19:26:06.219 INFO:tasks.ceph.osd.1.smithi005.stderr: 2019-11-27T19:26:06.680 INFO:tasks.ceph.osd.1.smithi005.stderr: 0> 2019-11-27T19:26:06.208+0000 36275700 -1 *** Caught signal (Aborted) ** 2019-11-27T19:26:06.680 INFO:tasks.ceph.osd.1.smithi005.stderr: in thread 36275700 thread_name:tp_osd_tp 2019-11-27T19:26:06.680 INFO:tasks.ceph.osd.1.smithi005.stderr: 2019-11-27T19:26:06.680 INFO:tasks.ceph.osd.1.smithi005.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 2: (_vgr20290ZU_libcZdsoZa___GI_mempcpy()+0x98) [0xa703ba8] 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 3: (_IO_default_xsputn()+0x11c) [0xd189f8c] 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 4: (_IO_vfprintf()+0x4a33) [0xd159fe3] 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 5: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 6: (cls_log()+0xfa) [0x69b07a] 2019-11-27T19:26:06.681 INFO:tasks.ceph.osd.1.smithi005.stderr: 7: (()+0x23201) [0x273f3201] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 8: (()+0x15342) [0x273e5342] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 9: (()+0x65bc6e) [0x763c6e] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 10: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 11: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 12: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 13: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T19:26:06.682 INFO:tasks.ceph.osd.1.smithi005.stderr: 14: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 15: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 16: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 17: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 18: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 19: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 20: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 21: (()+0x7e65) [0xc093e65] 2019-11-27T19:26:06.683 INFO:tasks.ceph.osd.1.smithi005.stderr: 22: (clone()+0x6d) [0xd20b88d] 2019-11-27T19:26:06.684 INFO:tasks.ceph.osd.1.smithi005.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T19:26:06.684 INFO:tasks.ceph.osd.1.smithi005.stderr: 2019-11-27T19:26:07.090 INFO:tasks.ceph.osd.1.smithi005.stderr: -51> 2019-11-27T19:26:06.208+0000 36275700 -1 *** Caught signal (Aborted) ** 2019-11-27T19:26:07.090 INFO:tasks.ceph.osd.1.smithi005.stderr: in thread 36275700 thread_name:tp_osd_tp 2019-11-27T19:26:07.090 INFO:tasks.ceph.osd.1.smithi005.stderr: 2019-11-27T19:26:07.091 INFO:tasks.ceph.osd.1.smithi005.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T19:26:07.091 INFO:tasks.ceph.osd.1.smithi005.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T19:26:07.091 INFO:tasks.ceph.osd.1.smithi005.stderr: 2: (_vgr20290ZU_libcZdsoZa___GI_mempcpy()+0x98) [0xa703ba8] 2019-11-27T19:26:07.091 INFO:tasks.ceph.osd.1.smithi005.stderr: 3: (_IO_default_xsputn()+0x11c) [0xd189f8c] 2019-11-27T19:26:07.091 INFO:tasks.ceph.osd.1.smithi005.stderr: 4: (_IO_vfprintf()+0x4a33) [0xd159fe3] 2019-11-27T19:26:07.091 INFO:tasks.ceph.osd.1.smithi005.stderr: 5: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 6: (cls_log()+0xfa) [0x69b07a] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 7: (()+0x23201) [0x273f3201] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 8: (()+0x15342) [0x273e5342] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 9: (()+0x65bc6e) [0x763c6e] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 10: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 11: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T19:26:07.092 INFO:tasks.ceph.osd.1.smithi005.stderr: 12: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 13: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 14: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 15: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 16: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 17: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 18: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T19:26:07.093 INFO:tasks.ceph.osd.1.smithi005.stderr: 19: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T19:26:07.094 INFO:tasks.ceph.osd.1.smithi005.stderr: 20: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T19:26:07.094 INFO:tasks.ceph.osd.1.smithi005.stderr: 21: (()+0x7e65) [0xc093e65] 2019-11-27T19:26:07.094 INFO:tasks.ceph.osd.1.smithi005.stderr: 22: (clone()+0x6d) [0xd20b88d] 2019-11-27T19:26:07.094 INFO:tasks.ceph.osd.1.smithi005.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T19:26:07.094 INFO:tasks.ceph.osd.1.smithi005.stderr: 2019-11-27T19:26:09.866 INFO:teuthology.orchestra.run.smithi005.stderr:testRangedGets (test.functional.tests.TestFile) ... ok 2019-11-27T19:26:09.960 INFO:tasks.ceph.osd.1.smithi005.stderr:daemon-helper: command crashed with signal 6 2019-11-27T19:26:10.525 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:10.520+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:10.809 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:10.803+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:11.502 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:11.495+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:11.580 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:11.574+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:11.786 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:11.779+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:12.510 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:12.504+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:12.541 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:12.535+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:12.805 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:12.799+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:13.276 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:13.271+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:13.486 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:13.482+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:13.543 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:13.537+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:13.840 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:13.831+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:14.310 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:14.305+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:14.467 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:14.461+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:14.574 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:14.568+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:14.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2019-11-27T19:26:14.740 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:14.735+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:14.800 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:14.795+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:15.276 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:15.271+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:15.464 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:15.459+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:15.547 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:15.542+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:15.775 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:15.769+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:15.805 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:15.799+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:16.318 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:16.309+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:16.318 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:16.313+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:16.467 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:16.462+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:16.509 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:16.503+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:16.738 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:16.732+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:16.771 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:16.765+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:17.329 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:17.322+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:17.329 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:17.324+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:17.513 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:17.507+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:17.548 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:17.542+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:17.695 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:17.689+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:17.787 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:17.782+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:18.382 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:18.374+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:18.382 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:18.377+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:18.538 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:18.533+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:18.575 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:18.570+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:18.657 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:18.652+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:18.808 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:18.803+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:19.399 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:19.390+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:19.400 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:19.395+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:19.498 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:19.494+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:19.591 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:19.585+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:19.628 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:19.622+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:19.822 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:19.817+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:20.366 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:20.361+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:20.368 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:20.364+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:20.529 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:20.522+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:20.572 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:20.567+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:20.583 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:20.578+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:20.862 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:20.857+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:20.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2019-11-27T19:26:21.327 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:21.321+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:21.328 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:21.323+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:21.509 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:21.504+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:21.606 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:21.600+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:21.617 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:21.609+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:21.836 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:21.830+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:22.293 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:22.286+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:22.301 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:22.288+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:22.558 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:22.552+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:22.576 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:22.571+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:22.610 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:22.604+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:22.827 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:22.816+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:23.334 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:23.327+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:23.335 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:23.330+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:23.530 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:23.524+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:23.557 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:23.551+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:23.582 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:23.577+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:23.777 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:23.771+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:24.349 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:24.344+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:24.352 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:24.347+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:24.526 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:24.518+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:24.544 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:24.538+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:24.550 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:24.545+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:24.778 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:24.772+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:25.379 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:25.372+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:25.379 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:25.374+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:25.518 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:25.514+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:25.521 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:25.515+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:25.575 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:25.570+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:25.771 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:25.766+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:26.335 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:26.329+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:26.335 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:26.330+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:26.475 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:26.469+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:26.522 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:26.516+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:26.569 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:26.563+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:26.831 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:26.824+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:27.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~13s 2019-11-27T19:26:27.368 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:27.362+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:27.372 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:27.365+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:27.462 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:27.457+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:27.517 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:27.511+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:27.566 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:27.561+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:27.866 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:27.860+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:28.407 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:28.402+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:28.410 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:28.406+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:28.444 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:28.438+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:28.474 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:28.469+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:28.527 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:28.523+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:28.856 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:28.851+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:29.407 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:29.402+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:29.409 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:29.405+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:29.445 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:29.439+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:29.478 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:29.474+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:29.516 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:29.510+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:29.906 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:29.901+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:30.390 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:30.380+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:30.390 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:30.384+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:30.446 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:30.440+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:30.492 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:30.487+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:30.505 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:30.499+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:30.941 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:30.933+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:31.439 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:31.432+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:31.440 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:31.434+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:31.480 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:31.474+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:31.540 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:31.533+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:31.551 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:31.545+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:31.897 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:31.891+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:32.463 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:32.455+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:32.469 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:32.463+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:32.470 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:32.464+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:32.497 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:32.490+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:32.540 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:32.534+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:32.943 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:32.937+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:33.449 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:33.444+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:31.145703+0000 front 2019-11-27T19:25:30.048110+0000 (oldest deadline 2019-11-27T19:26:15.589307+0000) 2019-11-27T19:26:33.453 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:33.448+0000 1694c700 -1 osd.7 227 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111977 5.5 5:a93a5511:::notify.2:head [watch ping cookie 363510528 gen 1] snapc 0=[] ondisk+write+known_if_redirected e226) 2019-11-27T19:26:33.458 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:26:33.452+0000 1694c700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:30.859205+0000 front 2019-11-27T19:25:30.860722+0000 (oldest deadline 2019-11-27T19:26:14.338933+0000) 2019-11-27T19:26:33.503 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:26:33.495+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:29.391335+0000 front 2019-11-27T19:25:29.332409+0000 (oldest deadline 2019-11-27T19:26:11.356426+0000) 2019-11-27T19:26:33.504 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:26:33.497+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.911404+0000 front 2019-11-27T19:25:30.289468+0000 (oldest deadline 2019-11-27T19:26:09.683915+0000) 2019-11-27T19:26:33.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~19s 2019-11-27T19:26:33.914 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:26:33.908+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:25:28.022885+0000 front 2019-11-27T19:25:28.006843+0000 (oldest deadline 2019-11-27T19:26:10.547151+0000) 2019-11-27T19:26:34.754 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:34.724+0000 1694c700 -1 osd.7 228 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:35.744 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:35.737+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:36.765 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:36.760+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:37.750 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:37.744+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:38.789 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:38.784+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:39.807 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:39.801+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:39.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2019-11-27T19:26:40.831 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:40.825+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:41.847 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:41.841+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:42.817 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:42.811+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:43.872 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:43.867+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:44.887 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:44.882+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:45.928 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:45.922+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:46.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~32s 2019-11-27T19:26:46.902 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:46.894+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:47.862 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:47.857+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:48.896 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:48.890+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:49.878 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:49.873+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:50.884 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:50.879+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:51.845 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:51.839+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:52.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~38s 2019-11-27T19:26:52.806 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:52.801+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:53.839 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:53.834+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:54.829 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:54.824+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:55.840 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:55.835+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:56.796 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:56.791+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:57.783 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:57.777+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:58.785 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:58.780+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:26:58.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~44s 2019-11-27T19:26:59.783 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:26:59.778+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:27:00.811 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:27:00.806+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:27:01.843 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:27:01.839+0000 1694c700 -1 osd.7 229 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:111993 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 363510528 gen 2] snapc 0=[] ondisk+write+known_if_redirected e227) 2019-11-27T19:27:02.512 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:27:02.507+0000 20e22700 -1 RGWWatcher::handle_error cookie 363510528 err (107) Transport endpoint is not connected 2019-11-27T19:27:05.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~51s 2019-11-27T19:27:11.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~57s 2019-11-27T19:27:17.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~63s 2019-11-27T19:27:24.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2019-11-27T19:27:30.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2019-11-27T19:27:31.385 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:27:31.373+0000 38a7a700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-27T19:27:31.553 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:27:31.545+0000 3b27f700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-27T19:27:31.599 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:27:31.557+0000 3a27d700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-27T19:27:31.906 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:27:31.712+0000 36275700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-27T19:27:31.951 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:27:31.884+0000 36275700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-27T19:27:31.969 INFO:tasks.ceph.osd.4.smithi115.stderr:2019-11-27T19:27:31.959+0000 3a27d700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-27T19:27:36.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2019-11-27T19:27:43.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2019-11-27T19:27:49.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2019-11-27T19:27:55.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~101s 2019-11-27T19:28:00.272 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:00.267+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:01.272 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:01.267+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:01.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~107s 2019-11-27T19:28:02.308 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:02.303+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:03.355 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:03.351+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:04.383 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:04.378+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:05.423 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:05.419+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:06.478 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:06.473+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:07.449 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:07.445+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:08.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~114s 2019-11-27T19:28:08.405 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:08.400+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:09.415 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:09.411+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:10.390 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:10.385+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:11.410 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:11.406+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:12.440 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:12.435+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:13.449 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:13.444+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:14.500 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:14.496+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:14.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2019-11-27T19:28:15.475 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:15.470+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:16.445 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:16.440+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:17.450 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:17.445+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:18.429 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:18.422+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:19.419 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:19.412+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:20.373 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:20.368+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:20.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~126s 2019-11-27T19:28:21.377 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:21.371+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:22.352 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:22.346+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:23.362 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:23.358+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:24.381 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:24.377+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:25.412 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:25.407+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:26.424 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:26.419+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:27.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~133s 2019-11-27T19:28:27.457 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:27.452+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:28.474 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:28.470+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:29.457 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:29.452+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:29.677 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:03.738 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.680 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:03.742 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.706 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:03.767 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.709 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:03.771 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.728 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:03.737 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.734 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:03.743 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.912 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:03.974 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.967 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:03.976 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:29.980 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:04.041 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:30.509 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:30.505+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:31.518 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:31.513+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:32.544 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:32.538+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:33.527 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:33.522+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:33.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~139s 2019-11-27T19:28:34.543 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:34.537+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:34.544 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:34.539+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:34.667 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:34.662+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:35.371 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:35.366+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:35.595 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:35.589+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:35.597 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:35.593+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:35.625 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:35.619+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:35.651 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:35.646+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:36.379 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:36.374+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:36.574 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:36.567+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:36.574 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:36.569+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:36.609 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:36.603+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:36.695 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:36.689+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:36.977 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:36.973+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:37.380 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:37.375+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:37.571 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:37.565+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:37.594 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:37.586+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:37.595 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:37.590+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:37.704 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:37.698+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:38.019 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:38.011+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:38.418 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:38.414+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:38.591 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:38.584+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:38.626 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:38.620+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:38.627 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:38.622+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:38.675 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:38.669+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:39.024 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:39.016+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:39.473 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:39.466+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:39.577 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:39.566+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:39.666 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:39.660+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:39.666 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:39.661+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:39.703 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:39.697+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:39.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2019-11-27T19:28:40.072 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:40.066+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:40.452 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:40.446+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:40.587 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:40.582+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:40.704 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:40.698+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:40.713 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:40.708+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:40.716 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:40.712+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:41.042 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:41.036+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:41.481 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:41.475+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:41.548 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:41.543+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:41.678 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:41.673+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:41.681 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:41.677+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:41.699 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:41.694+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:42.056 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:42.050+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:42.506 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:42.501+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:42.535 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:42.529+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:42.675 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:42.668+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:42.678 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:42.670+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:42.712 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:42.705+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:43.064 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:43.059+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:43.489 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:43.484+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:43.496 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:43.492+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:43.696 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:43.690+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:43.698 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:43.694+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:43.719 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:43.713+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:44.030 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:44.025+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:44.454 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:44.448+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:44.489 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:44.484+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:44.738 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:44.732+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:44.742 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:44.737+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:44.761 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:44.755+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:45.056 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:45.051+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:45.434 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:45.429+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:45.498 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:45.492+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:45.729 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:45.723+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:45.775 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:45.770+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:45.778 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:45.774+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:46.069 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:46.063+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:46.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2019-11-27T19:28:46.467 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:46.461+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:46.474 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:46.469+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:46.769 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:46.762+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:46.769 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:46.764+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:46.775 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:46.770+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:47.031 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:47.020+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:47.425 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:47.419+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:47.498 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:47.493+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:47.790 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:47.783+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:47.790 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:47.785+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:47.829 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:47.823+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:48.010 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:48.005+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:48.459 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:48.454+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:48.533 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:48.527+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:48.783 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:48.777+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:48.784 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:48.779+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:48.842 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:48.837+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:49.003 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:48.998+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:49.459 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:49.453+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:49.582 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:49.576+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:49.831 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:49.825+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:49.832 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:49.827+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:49.874 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:49.869+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:49.991 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:49.986+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:50.426 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:50.421+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:50.616 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:50.610+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:50.842 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:50.836+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:50.843 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:50.838+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:50.863 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:50.857+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:50.988 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:50.983+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:51.453 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:51.447+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:51.613 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:51.609+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:51.815 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:51.807+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:51.816 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:51.809+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:51.912 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:51.907+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:52.041 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:52.035+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:52.422 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:52.417+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:52.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2019-11-27T19:28:52.638 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:52.632+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:52.777 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:52.771+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:52.780 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:52.776+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:52.971 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:52.961+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:53.022 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:53.017+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:53.427 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:53.422+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:53.648 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:53.643+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:53.816 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:53.809+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:53.818 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:53.813+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:53.968 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:53.963+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:53.985 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:53.979+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:54.424 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:54.418+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:54.672 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:54.666+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:54.792 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:54.784+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:54.793 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:54.788+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:54.952 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:54.946+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:55.001 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:54.995+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:55.461 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:55.456+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:55.708 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:55.703+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:55.805 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:55.798+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:55.806 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:55.800+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:55.961 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:55.955+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:56.022 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:56.017+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:56.514 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:56.509+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:56.755 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:56.746+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:56.762 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:56.755+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:56.763 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:56.757+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:56.929 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:56.924+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:57.049 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:57.043+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:57.553 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:57.546+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:57.736 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:57.729+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:57.736 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:57.729+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:57.741 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:57.733+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:57.909 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:57.903+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:58.008 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:58.003+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:58.526 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:58.519+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:58.763 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:58.757+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:58.790 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:58.785+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:58.794 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:58.789+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:58.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~164s 2019-11-27T19:28:58.874 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:58.867+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:28:59.038 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:28:59.033+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:28:59.571 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:28:59.563+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:28:59.743 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:28:59.736+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:28:59.795 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:59.790+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:28:59.798 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:28:59.793+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:28:59.867 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:28:59.860+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:00.017 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:00.010+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:00.573 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:00.567+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:00.753 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:00.748+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:00.755 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:00.749+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:00.757 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:00.752+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:00.843 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:00.836+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:01.037 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:01.031+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:01.567 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:01.560+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:01.718 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:01.711+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:01.718 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:01.713+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:01.721 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:01.715+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:01.829 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:01.822+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:02.080 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:02.074+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:02.613 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:02.606+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:02.701 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:02.695+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:02.704 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:02.700+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:02.760 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:02.753+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:02.856 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:02.849+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:03.077 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:03.071+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:03.595 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:03.590+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:03.728 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:03.721+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:03.732 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:03.724+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:03.741 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:03.735+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:03.834 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:03.829+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:04.038 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:04.033+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:04.645 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:04.640+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:04.708 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:04.702+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:04.712 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:04.707+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:04.790 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:04.784+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:04.799 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:04.794+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:05.076 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:05.069+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:05.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~171s 2019-11-27T19:29:05.652 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:05.647+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:05.699 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:05.693+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:05.700 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:05.695+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:05.793 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:05.788+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:05.807 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:05.803+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:06.131 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:06.125+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:06.685 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:06.679+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:06.691 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:06.685+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:06.692 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:06.687+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:06.781 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:06.776+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:06.813 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:06.805+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:07.122 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:07.117+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:07.254 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:29:07.247+0000 1694c700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.169494+0000 front 2019-11-27T19:27:54.127364+0000 (oldest deadline 2019-11-27T19:29:06.729180+0000) 2019-11-27T19:29:07.672 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:29:07.666+0000 1694c700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:55.312025+0000 front 2019-11-27T19:27:49.373605+0000 (oldest deadline 2019-11-27T19:28:34.963612+0000) 2019-11-27T19:29:07.675 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:07.668+0000 1694c700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:56.161237+0000 front 2019-11-27T19:27:54.873874+0000 (oldest deadline 2019-11-27T19:28:34.266880+0000) 2019-11-27T19:29:07.676 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:07.670+0000 1694c700 -1 osd.7 233 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:07.758 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:07.753+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:07.863 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:29:07.857+0000 1694c700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.808950+0000 front 2019-11-27T19:27:52.169208+0000 (oldest deadline 2019-11-27T19:28:36.903627+0000) 2019-11-27T19:29:08.150 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:29:08.142+0000 1694c700 -1 osd.5 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.131237+0000 front 2019-11-27T19:27:52.569849+0000 (oldest deadline 2019-11-27T19:28:34.854307+0000) 2019-11-27T19:29:08.225 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:29:08.219+0000 1694c700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:52.169494+0000 front 2019-11-27T19:27:54.127364+0000 (oldest deadline 2019-11-27T19:29:06.729180+0000) 2019-11-27T19:29:08.792 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:29:08.786+0000 1694c700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:27:49.380909+0000 front 2019-11-27T19:27:54.887298+0000 (oldest deadline 2019-11-27T19:28:33.945687+0000) 2019-11-27T19:29:08.986 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:08.883+0000 1694c700 -1 osd.7 234 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:10.168 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:10.133+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:11.190 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:11.185+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:11.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~177s 2019-11-27T19:29:11.785 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:45.847 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.798 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:45.859 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.808 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:45.869 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.815 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:45.877 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.819 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:45.828 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.840 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:45.849 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.927 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:45.989 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.931 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:45.992 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:11.952 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:45.961 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:12.233 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:12.227+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:13.188 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:13.183+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:14.175 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:14.170+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:15.193 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:15.188+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:16.179 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:16.174+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:17.172 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:17.167+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:17.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~183s 2019-11-27T19:29:18.154 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:18.149+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:19.138 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:19.133+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:20.109 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:20.104+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:21.086 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:21.081+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:22.077 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:22.071+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:23.107 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:23.102+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:24.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~189s 2019-11-27T19:29:24.073 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:24.068+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:25.099 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:59.161 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.124 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:25.118+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:25.166 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:59.228 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.174 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:59.235 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.194 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:59.255 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.206 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:34:59.267 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.213 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:59.222 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.219 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:59.228 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.227 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:34:59.288 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:25.254 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:34:59.263 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:29:26.091 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:26.085+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:27.079 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:27.074+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:28.060 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:28.054+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:29.074 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:29.068+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:30.056 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:30.050+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:30.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~196s 2019-11-27T19:29:31.059 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:31.054+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:31.453 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:29:31.252+0000 20e22700 -1 RGWWatcher::handle_error cookie 821242208 err (107) Transport endpoint is not connected 2019-11-27T19:29:32.029 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:32.022+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:33.056 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:33.050+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:34.056 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:34.050+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:35.030 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:35.025+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:36.053 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:36.047+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:36.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~202s 2019-11-27T19:29:37.073 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:37.068+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:38.056 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:38.050+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:39.040 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:39.034+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:40.022 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:40.014+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:40.984 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:40.978+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:41.971 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:29:41.967+0000 1694c700 -1 osd.7 235 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:112254 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5449978336 gen 2] snapc 0=[] ondisk+write+known_if_redirected e231) 2019-11-27T19:29:43.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~208s 2019-11-27T19:29:43.018 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:29:42.796+0000 20e22700 -1 RGWWatcher::handle_error cookie 5449978336 err (107) Transport endpoint is not connected 2019-11-27T19:29:49.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2019-11-27T19:29:52.126 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:29:52.116+0000 1a899700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-11-27T19:29:55.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~221s 2019-11-27T19:30:01.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~227s 2019-11-27T19:30:08.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~234s 2019-11-27T19:30:14.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2019-11-27T19:30:20.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~246s 2019-11-27T19:30:24.063 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:24.057+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:25.060 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:25.055+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:26.014 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:26.010+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:27.006 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:27.002+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:27.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~253s 2019-11-27T19:30:28.019 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:28.014+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:29.067 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:29.062+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:30.106 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:30.101+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:31.119 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:31.114+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:32.109 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:32.104+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:33.073 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:33.068+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:33.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~259s 2019-11-27T19:30:34.037 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:34.032+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:35.078 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:35.073+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:36.049 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:36.039+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:37.082 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:37.077+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:38.126 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:38.121+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:39.132 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:39.125+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:39.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2019-11-27T19:30:40.171 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:40.166+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:41.170 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:41.166+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:42.219 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:42.214+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:43.182 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:43.177+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:44.170 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:44.165+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:45.173 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:45.168+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:46.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~272s 2019-11-27T19:30:46.187 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:46.182+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:47.228 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:47.224+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:48.249 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:48.244+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:49.299 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:49.293+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:50.351 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:50.345+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:51.371 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:51.365+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:52.357 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:52.351+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:52.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~278s 2019-11-27T19:30:53.369 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:53.364+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:54.348 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:54.344+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:55.371 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:55.366+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:56.424 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:56.419+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:57.449 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:57.444+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:58.480 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:58.471+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:58.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~284s 2019-11-27T19:30:59.514 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:30:59.509+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:30:59.985 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:30:59.979+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:00.353 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:00.349+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:00.528 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:00.521+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:00.528 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:00.523+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:00.595 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:00.590+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:00.980 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:00.974+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:01.316 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:01.311+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:01.387 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:01.382+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:01.542 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:01.536+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:01.542 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:01.538+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:01.628 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:01.623+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:02.007 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:02.002+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:02.324 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:02.319+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:02.412 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:02.407+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:02.561 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:02.555+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:02.561 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:02.556+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:02.594 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:02.588+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:03.038 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:03.032+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:03.315 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:03.307+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:03.440 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:03.434+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:03.600 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:03.594+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:03.600 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:03.595+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:03.631 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:03.625+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:03.803 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:03.798+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:04.019 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:04.012+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:04.289 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:04.283+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:04.466 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:04.460+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:04.625 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:04.620+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:04.648 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:04.642+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:04.648 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:04.643+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:04.814 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:04.808+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:04.996 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:04.990+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:05.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~291s 2019-11-27T19:31:05.294 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:05.288+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:05.459 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:05.454+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:05.633 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:05.627+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:05.634 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:05.627+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:05.634 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:05.629+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:05.830 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:05.824+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:05.990 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:05.984+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:06.358 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:06.353+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:06.417 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:06.411+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:06.620 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:06.614+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:06.621 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:06.616+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:06.625 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:06.619+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:06.878 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:06.872+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:06.964 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:06.958+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:07.347 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:07.342+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:07.416 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:07.411+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:07.598 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:07.592+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:07.661 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:07.654+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:07.662 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:07.656+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:07.901 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:07.894+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:07.923 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:07.917+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:08.387 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:08.382+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:08.400 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:08.395+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:08.644 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:08.638+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:08.690 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:08.683+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:08.691 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:08.684+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:08.920 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:08.914+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:08.949 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:08.945+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:09.358 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:09.352+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:09.360 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:09.355+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:09.600 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:09.595+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:09.713 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:09.707+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:09.714 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:09.709+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:09.914 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:09.908+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:09.974 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:09.969+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:10.375 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:10.369+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:10.393 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:10.388+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:10.626 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:10.621+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:10.689 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:10.682+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:10.690 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:10.685+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:10.942 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:10.936+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:10.971 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:10.964+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:11.397 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:11.392+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:11.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~297s 2019-11-27T19:31:11.428 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:11.422+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:11.643 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:11.637+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:11.683 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:11.677+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:11.684 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:11.679+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:11.927 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:11.922+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:11.962 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:11.956+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:12.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:12.400+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:12.416 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:12.410+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:12.666 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:12.660+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:12.683 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:12.677+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:12.684 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:12.679+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:12.896 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:12.889+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:12.924 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:12.918+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:13.411 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:13.406+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:13.443 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:13.438+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:13.680 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:13.674+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:13.722 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:13.716+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:13.723 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:13.717+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:13.914 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:13.908+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:13.938 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:13.932+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:14.381 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:14.376+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:14.453 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:14.448+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:14.639 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:14.633+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:14.717 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:14.710+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:14.717 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:14.712+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:14.956 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:14.951+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:14.980 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:14.974+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:15.371 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:15.365+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:15.438 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:15.433+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:15.606 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:15.601+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:15.746 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:15.739+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:15.747 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:15.742+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:15.915 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:15.909+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:15.947 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:15.941+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:16.389 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:16.385+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:16.428 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:16.422+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:16.624 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:16.618+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:16.748 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:16.742+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:16.748 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:16.744+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:16.958 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:16.953+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:16.995 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:16.990+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:17.393 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:17.389+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:17.418 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:17.413+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:17.613 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:17.607+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:17.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~303s 2019-11-27T19:31:17.734 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-11-27T19:31:17.734 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-11-27T19:31:17.783 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:17.777+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:17.783 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:17.779+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:17.933 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:17.927+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:18.011 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:18.005+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:18.372 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:18.367+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:18.392 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:18.387+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:18.612 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:18.603+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:18.751 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:18.744+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:18.751 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:18.746+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:18.966 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:18.960+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:19.050 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:19.045+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:19.353 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:19.348+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:19.431 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:19.425+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:19.568 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:19.562+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:19.771 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:19.765+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:19.772 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:19.767+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:19.955 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:19.949+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:20.068 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:20.062+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:20.372 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:20.367+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:20.395 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:20.391+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:20.552 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:20.546+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:20.730 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:20.723+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:20.731 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:20.726+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:20.982 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:20.976+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:21.037 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:21.032+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:21.413 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:21.408+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:21.443 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:21.439+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:21.529 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:21.523+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:21.729 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:21.723+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:21.730 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:21.725+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:22.000 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:21.994+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:22.018 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:22.013+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:22.410 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:22.406+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:22.425 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:22.421+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:22.502 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:22.496+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:22.707 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:22.701+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:22.708 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:22.703+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:23.041 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:23.036+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:23.048 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:23.043+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:23.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:23.400+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:23.424 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:23.419+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:23.503 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:23.497+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:23.697 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:23.692+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:23.698 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:23.693+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:24.052 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:24.046+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:24.074 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:24.068+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:24.443 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:24.438+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:24.461 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:24.454+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:24.482 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:24.476+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:24.702 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:24.696+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:24.703 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:24.698+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:25.047 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:25.039+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:25.075 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:25.068+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:25.414 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:25.408+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:25.453 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:25.445+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:25.467 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:25.462+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:25.708 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:25.701+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:25.709 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:25.704+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:26.072 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:26.065+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:26.077 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:26.072+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:26.393 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:26.386+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:26.470 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:26.463+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:26.485 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:26.479+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:26.742 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:26.736+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:26.742 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:26.737+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:27.098 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:27.092+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:27.109 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:27.102+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:27.384 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:27.378+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:27.453 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:27.447+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:27.492 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:27.485+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:27.758 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:27.751+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:27.759 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:27.753+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:28.137 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:28.131+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:28.149 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:28.142+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:28.367 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:28.361+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:28.451 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:28.445+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:28.507 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:28.499+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:28.797 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:28.791+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:28.798 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:28.793+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:29.134 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:29.125+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:29.155 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:29.149+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:29.398 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:29.393+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:29.482 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:29.478+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:29.492 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:29.487+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:29.842 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:29.835+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:29.842 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:29.838+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:30.139 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:30.132+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:30.170 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:30.165+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:30.415 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:30.410+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:30.467 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:30.462+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:30.489 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:30.484+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:30.844 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:30.837+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:30.848 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:30.839+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:31.181 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:31.176+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:31.181 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:31.176+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:31.406 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:31.401+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:31.456 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:31.448+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:31.482 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:31.476+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:31.859 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:31.852+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:31.860 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:31.855+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:32.171 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:32.163+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:32.189 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:32.184+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:32.377 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:32.372+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:32.493 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:32.488+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:32.506 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:32.501+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:32.843 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:32.836+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:32.844 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:32.839+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:33.159 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:33.153+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:33.169 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:33.163+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:33.378 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:33.373+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:33.487 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:33.482+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:33.549 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:33.544+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:33.804 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:33.798+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:33.805 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:33.799+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:34.129 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:34.124+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:34.146 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:34.142+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:34.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:34.400+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:34.442 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:34.438+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:34.598 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:34.592+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:34.869 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:34.860+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:16.117023+0000 front 2019-11-27T19:30:16.137959+0000 (oldest deadline 2019-11-27T19:31:00.135884+0000) 2019-11-27T19:31:34.871 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:34.863+0000 1694c700 -1 osd.7 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:35.112 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:31:35.106+0000 1694c700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:19.420487+0000 front 2019-11-27T19:30:18.886372+0000 (oldest deadline 2019-11-27T19:31:02.850112+0000) 2019-11-27T19:31:35.119 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:31:35.114+0000 1694c700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.984449+0000 front 2019-11-27T19:30:18.000795+0000 (oldest deadline 2019-11-27T19:30:59.498633+0000) 2019-11-27T19:31:35.395 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:31:35.390+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499695+0000 front 2019-11-27T19:30:14.411997+0000 (oldest deadline 2019-11-27T19:31:00.171170+0000) 2019-11-27T19:31:35.406 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:31:35.401+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:15.499295+0000 front 2019-11-27T19:30:15.273421+0000 (oldest deadline 2019-11-27T19:31:00.775443+0000) 2019-11-27T19:31:35.621 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:31:35.614+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 44sec e238 v238) 2019-11-27T19:31:35.628 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:31:35.622+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:30:18.070400+0000 front 2019-11-27T19:30:17.980125+0000 (oldest deadline 2019-11-27T19:30:59.773580+0000) 2019-11-27T19:31:36.144 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:35.996+0000 1694c700 -1 osd.7 239 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:37.261 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:37.243+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:38.236 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:38.231+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:39.189 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:39.183+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:40.225 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:40.219+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:41.221 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:41.215+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:42.195 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:42.189+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:43.167 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:43.161+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:44.140 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:44.134+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:45.144 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:45.139+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:46.148 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:46.144+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:47.150 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:47.142+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:48.198 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:48.192+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:49.223 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:49.218+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:50.247 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:50.242+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:51.213 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:51.207+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:52.187 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:52.180+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:53.172 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:53.166+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:54.192 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:54.186+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:55.226 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:55.221+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:56.195 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:56.189+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:57.220 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:57.214+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:58.256 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:58.251+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:31:59.231 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:31:59.227+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:00.248 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:00.243+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:01.302 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:01.296+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:02.349 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:02.343+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:03.358 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:03.351+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:04.343 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:04.337+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:05.345 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:05.336+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:05.808 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:32:05.778+0000 20e22700 -1 RGWWatcher::handle_error cookie 1470965808 err (107) Transport endpoint is not connected 2019-11-27T19:32:05.948 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:32:05.944+0000 1694c700 -1 osd.2 240 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112646 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 94] snapc 0=[] ondisk+write+known_if_redirected e239) 2019-11-27T19:32:06.300 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:06.293+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:06.920 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:32:06.916+0000 1694c700 -1 osd.2 240 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112646 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821039296 gen 94] snapc 0=[] ondisk+write+known_if_redirected e239) 2019-11-27T19:32:07.348 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:07.342+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:08.399 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:08.392+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:09.437 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:09.432+0000 1694c700 -1 osd.7 240 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:112492 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 360793024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e237) 2019-11-27T19:32:10.416 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:32:10.287+0000 20e22700 -1 RGWWatcher::handle_error cookie 360793024 err (107) Transport endpoint is not connected 2019-11-27T19:32:13.434 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:13.335+0000 114ab700 -1 osd.7 242 build_incremental_map_msg missing incremental map 242 2019-11-27T19:32:13.862 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:32:13.855+0000 3aa7e700 -1 osd.3 242 build_incremental_map_msg missing incremental map 242 2019-11-27T19:32:13.874 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:13.866+0000 36275700 -1 osd.7 242 build_incremental_map_msg missing incremental map 242 2019-11-27T19:32:44.299 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:44.295+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:45.297 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:45.292+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:46.286 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:46.280+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:47.241 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:47.236+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:48.286 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:48.281+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:49.262 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:49.258+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:50.238 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:50.233+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:51.213 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:51.208+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:52.245 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:52.241+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:53.279 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:53.274+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:54.288 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:54.284+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:55.324 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:55.318+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:56.335 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:56.329+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:57.347 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:57.342+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:58.397 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:58.393+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:32:59.381 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:32:59.376+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:00.383 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:00.378+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:01.367 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:01.362+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:02.395 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:02.390+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:03.412 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:03.407+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:04.412 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:04.403+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:04.436 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:38:38.497 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.452 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:38:38.514 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.462 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:38:38.471 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.472 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:38:38.481 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.476 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:38:38.538 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.481 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:38:38.543 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.742 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:38:38.804 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.753 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:38:38.815 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:04.802 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:38:38.811 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:33:05.433 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:05.428+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:06.406 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:06.401+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:07.432 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:07.427+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:08.458 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:08.453+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:09.453 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:09.443+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:10.502 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:10.497+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:11.496 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:11.491+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:12.542 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:12.537+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:13.496 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:13.491+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:14.495 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:14.490+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:15.383 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:15.378+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:15.531 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:15.524+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:15.531 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:15.526+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:15.805 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:15.800+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:16.369 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:16.362+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:16.553 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:16.547+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:16.553 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:16.548+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:16.805 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:16.799+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:17.047 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:17.042+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:17.330 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:17.325+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:17.523 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:17.516+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:17.523 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:17.518+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:17.847 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:17.841+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:18.039 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:18.033+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:18.330 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:18.324+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:18.507 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:18.500+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:18.507 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:18.501+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:18.873 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:18.867+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:19.041 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:19.035+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:19.375 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:19.369+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:19.511 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:19.501+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:19.513 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:19.505+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:19.917 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:19.911+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:20.082 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:20.074+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:20.124 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:20.117+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:20.427 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:20.421+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:20.510 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:20.502+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:20.510 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:20.504+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:20.900 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:20.893+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:21.119 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:21.114+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:21.128 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:21.124+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:21.474 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:21.470+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:21.479 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:21.472+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:21.480 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:21.474+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:21.885 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:21.878+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:21.906 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:21.900+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:22.109 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:22.104+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:22.149 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:22.144+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:22.479 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:22.474+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:22.491 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:22.484+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:22.491 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:22.486+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:22.912 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:22.906+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:22.940 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:22.935+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:23.115 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:23.109+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:23.177 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:23.172+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:23.518 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:23.512+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:23.534 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:23.525+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:23.534 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:23.526+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:23.922 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:23.916+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:23.973 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:23.967+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:24.092 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:24.087+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:24.183 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:24.178+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:24.503 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:24.497+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:24.503 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:24.498+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:24.568 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:24.562+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:24.950 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:24.944+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:24.980 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:24.974+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:25.057 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:25.051+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:25.178 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:25.173+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:25.491 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:25.478+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:25.491 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:25.481+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:25.591 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:25.585+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:25.905 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:25.899+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:25.961 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:25.955+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:26.013 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:26.007+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:26.141 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:26.137+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:26.508 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:26.501+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:26.509 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:26.503+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:26.628 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:26.622+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:26.910 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:26.904+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:26.916 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:26.910+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:26.991 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:26.986+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:27.185 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:27.180+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:27.484 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:27.478+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:27.485 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:27.480+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:27.613 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:27.608+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:27.922 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:27.916+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:27.936 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:27.930+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:28.011 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:28.006+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:28.183 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:28.178+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:28.511 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:28.505+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:28.512 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:28.507+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:28.603 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:28.595+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:28.895 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:28.889+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:28.924 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:28.918+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:29.017 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:29.012+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:29.234 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:29.228+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:29.519 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:29.512+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:29.520 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:29.514+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:29.560 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:29.554+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:29.918 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:29.912+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:29.946 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:29.940+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:30.026 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:30.021+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:30.260 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:30.255+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:30.493 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:30.486+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:30.493 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:30.488+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:30.575 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:30.570+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:30.913 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:30.906+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:30.930 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:30.912+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:31.071 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:31.065+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:31.258 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:31.254+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:31.536 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:31.531+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:31.547 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:31.539+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:31.547 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:31.542+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:31.867 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:31.861+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:31.897 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:31.891+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:32.103 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:32.097+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:32.252 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:32.248+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:32.495 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:32.490+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:32.572 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:32.566+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:32.573 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:32.568+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:32.833 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:32.827+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:32.885 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:32.880+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:33.100 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:33.094+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:33.225 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:33.219+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:33.467 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:33.456+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:33.587 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:33.581+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:33.588 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:33.583+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:33.815 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:33.809+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:33.902 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:33.897+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:34.138 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:34.132+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:34.198 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:34.192+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:34.495 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:34.490+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:34.576 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:34.569+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:34.576 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:34.571+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:34.819 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:34.812+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:34.909 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:34.904+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:35.141 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:35.136+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:35.170 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:35.165+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:35.457 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:35.452+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:35.552 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:35.545+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:35.553 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:35.547+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:35.829 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:35.819+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:35.932 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:35.927+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:36.129 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:36.123+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:36.210 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:36.206+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:36.498 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:36.493+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:36.557 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:36.551+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:36.558 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:36.553+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:36.796 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:36.790+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:36.891 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:36.886+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:37.139 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:37.133+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:37.181 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:37.177+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:37.508 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:37.503+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:37.573 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:37.567+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:37.574 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:37.569+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:37.849 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:37.843+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:37.940 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:37.933+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:38.189 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:38.184+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:38.210 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:38.192+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:38.478 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:38.473+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:38.588 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:38.582+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:38.588 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:38.583+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:38.840 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:38.834+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:38.932 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:38.926+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:39.176 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:39.171+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:39.198 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:39.193+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:39.460 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:39.456+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:39.554 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:39.548+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:39.555 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:39.550+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:39.831 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:39.825+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:39.938 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:39.932+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:40.164 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:40.159+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:40.230 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:40.226+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:40.478 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:40.473+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:40.547 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:40.541+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:40.548 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:40.543+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:40.842 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:40.836+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:40.953 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:40.948+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:41.123 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:41.118+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:41.185 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:41.179+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:41.506 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:41.500+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:41.553 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:41.547+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:41.554 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:41.548+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:41.895 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:41.888+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:41.918 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:41.912+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:42.150 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:42.145+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:42.170 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:42.165+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:42.540 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:42.530+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:42.543 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:42.533+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:42.546 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:42.541+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:42.871 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:42.864+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:42.872 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:42.868+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:43.147 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:43.141+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:43.151 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:43.146+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:43.515 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:43.509+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:43.516 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:43.511+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:43.564 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:43.559+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:43.850 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:43.844+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:43.881 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:43.872+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:44.170 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:44.165+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:44.171 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:44.165+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:44.525 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:44.518+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:44.526 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:44.520+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:44.613 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:44.607+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:44.835 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:44.829+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:44.887 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:44.880+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:45.196 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:45.190+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:45.212 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:45.207+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:45.548 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:45.539+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:45.548 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:45.542+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:45.625 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:45.619+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:45.789 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:45.783+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:45.906 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:45.901+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:46.210 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:46.205+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:46.241 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:46.236+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:46.527 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:46.520+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:46.527 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:46.522+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:46.673 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:46.668+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:46.802 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:46.797+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:46.902 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:46.896+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:47.169 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:47.162+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:47.295 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:47.290+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:47.579 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:47.572+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:47.580 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:47.575+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:47.716 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:47.711+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:47.807 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:47.801+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:47.899 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:47.893+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:48.163 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:48.158+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:48.349 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:48.344+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:48.611 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:48.602+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:48.611 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:48.604+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:48.759 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:48.754+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:48.851 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:48.844+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:48.923 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:48.917+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:49.148 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:49.143+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:49.339 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:49.333+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:49.634 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:49.627+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:49.635 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:49.630+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:49.776 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:49.769+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:49.824 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:49.819+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:49.926 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:49.921+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:50.188 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:50.182+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:50.334 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:50.329+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:50.606 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:50.599+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:50.607 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:50.602+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:50.777 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:50.770+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:50.785 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:50.779+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:50.881 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:50.875+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:51.153 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:51.146+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:51.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:33:51.149+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 38sec e243 v243) 2019-11-27T19:33:51.334 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:51.329+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:51.614 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:51.607+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:51.615 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:51.610+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:51.816 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:51.811+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:51.823 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:51.816+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:51.915 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:51.910+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:52.135 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:52.129+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:52.350 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:52.344+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:52.631 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:52.623+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:52.632 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:52.626+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:52.824 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:52.817+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:52.825 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:52.819+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:52.927 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:52.921+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:53.154 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:53.148+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:53.321 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:53.315+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:53.592 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:53.585+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:53.592 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:53.588+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:53.849 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:53.842+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:53.875 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:53.870+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:53.913 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:53.908+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:54.162 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:54.155+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:54.330 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:54.323+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:54.580 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:54.568+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:54.582 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:54.571+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:54.872 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:54.866+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:54.929 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:54.923+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:54.945 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:54.939+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:55.164 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:55.157+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:55.355 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:55.348+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:55.613 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:55.605+0000 1694c700 -1 osd.7 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:35.484515+0000 front 2019-11-27T19:32:33.889222+0000 (oldest deadline 2019-11-27T19:33:15.081570+0000) 2019-11-27T19:33:55.614 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:55.608+0000 1694c700 -1 osd.7 243 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:55.851 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:33:55.845+0000 1694c700 -1 osd.3 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.925534+0000 front 2019-11-27T19:32:37.998498+0000 (oldest deadline 2019-11-27T19:33:14.403856+0000) 2019-11-27T19:33:55.897 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:33:55.891+0000 1694c700 -1 osd.6 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:37.543592+0000 front 2019-11-27T19:32:37.889989+0000 (oldest deadline 2019-11-27T19:33:21.240852+0000) 2019-11-27T19:33:55.950 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:33:55.945+0000 1694c700 -1 osd.5 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.148358+0000 front 2019-11-27T19:32:38.091191+0000 (oldest deadline 2019-11-27T19:33:15.789146+0000) 2019-11-27T19:33:56.132 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:33:56.126+0000 1694c700 -1 osd.2 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.143714+0000 front 2019-11-27T19:32:38.147858+0000 (oldest deadline 2019-11-27T19:33:19.917302+0000) 2019-11-27T19:33:56.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:33:56.214+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 38sec e243 v243) 2019-11-27T19:33:56.396 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:33:56.391+0000 1694c700 -1 osd.0 243 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:32:38.091640+0000 front 2019-11-27T19:32:38.033409+0000 (oldest deadline 2019-11-27T19:33:16.415148+0000) 2019-11-27T19:33:56.848 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:56.762+0000 1694c700 -1 osd.7 244 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:57.867 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:57.861+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:58.901 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:58.896+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:33:59.928 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:33:59.923+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:00.967 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:00.963+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:01.975 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:01.970+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:03.014 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:03.008+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:04.009 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:04.001+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:05.047 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:05.041+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:06.023 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:06.018+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:07.052 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:07.047+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:08.027 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:08.021+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:09.006 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:09.001+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:10.049 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:10.043+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:11.096 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:11.089+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:12.153 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:12.148+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:13.200 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:13.195+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:14.241 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:14.235+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:15.230 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:15.225+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:16.213 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:16.208+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:17.198 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:17.192+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:18.224 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:18.218+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:19.254 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:19.249+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:19.447 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:34:19.253+0000 20e22700 -1 RGWWatcher::handle_error cookie 5415455728 err (107) Transport endpoint is not connected 2019-11-27T19:34:20.269 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:20.263+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:21.260 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:21.255+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:22.238 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:22.233+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:23.212 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:23.206+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:24.206 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:24.201+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:25.189 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:25.184+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:26.184 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:26.178+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:27.143 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:34:27.136+0000 1694c700 -1 osd.7 245 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112720 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5451076880 gen 1] snapc 0=[] ondisk+write+known_if_redirected e242) 2019-11-27T19:34:28.053 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:34:28.031+0000 20e22700 -1 RGWWatcher::handle_error cookie 5451076880 err (107) Transport endpoint is not connected 2019-11-27T19:34:30.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:34:30.622+0000 1a899700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-11-27T19:35:03.586 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:03.581+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:04.568 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:04.563+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:05.547 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:05.542+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:06.523 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:06.518+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:07.523 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:07.518+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:08.571 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:08.565+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:09.537 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:09.532+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:10.503 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:10.499+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:11.551 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:11.546+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:12.603 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:12.598+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:13.652 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:13.646+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:14.620 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:14.615+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:15.644 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:15.640+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:16.694 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:16.689+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:17.735 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:17.730+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:18.725 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:18.721+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:19.717 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:19.708+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:20.684 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:20.679+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:21.682 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:21.677+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:22.641 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:22.636+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:23.642 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:23.637+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:24.621 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:24.616+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:25.641 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:25.635+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:26.675 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:26.670+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:27.654 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:27.649+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:28.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:28.646+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:29.633 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:29.628+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:30.681 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:30.676+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:31.730 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:31.724+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:32.707 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:32.702+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:33.735 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:33.730+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:34.708 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:34.702+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:35.729 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:35.724+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:36.448 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:36.443+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:36.728 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:36.723+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:37.469 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:37.463+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:37.747 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:37.741+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:37.748 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:37.743+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:38.162 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:38.156+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:38.465 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:38.460+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:38.723 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:38.716+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:38.724 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:38.718+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:39.182 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:39.175+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:39.459 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:39.454+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:39.568 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:39.563+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:39.592 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:39.586+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:39.710 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:39.702+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:39.710 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:39.705+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:40.144 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:40.138+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:40.422 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:40.416+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:40.438 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:40.432+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:40.578 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:40.572+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:40.592 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:40.587+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:40.737 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:40.732+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:40.740 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:40.736+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:41.153 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:41.148+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:41.438 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:41.432+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:41.479 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:41.474+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:41.580 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:41.574+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:41.593 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:41.587+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:41.701 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:41.695+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:41.702 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:41.697+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:42.146 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:42.141+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:42.411 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:42.405+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:42.496 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:42.490+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:42.580 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:42.574+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:42.628 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:42.623+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:42.702 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:42.695+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:42.702 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:42.697+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:43.153 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:43.149+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:43.455 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:43.449+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:43.461 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:43.454+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:43.592 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:43.586+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:43.661 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:43.655+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:43.704 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:43.697+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:43.705 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:43.699+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:44.194 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:44.189+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:44.482 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:44.475+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:44.512 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:44.508+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:44.630 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:44.624+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:44.674 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:44.669+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:44.735 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:44.728+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:44.736 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:44.730+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:45.228 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:45.222+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:45.496 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:45.491+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:45.528 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:45.522+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:45.641 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:45.635+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:45.666 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:45.660+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:45.720 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:45.715+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:45.723 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:45.718+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:46.266 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:46.261+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:46.465 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:46.460+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:46.540 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:46.535+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:46.595 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:35:46.590+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.478688+0000 front 2019-11-27T19:34:56.471351+0000 (oldest deadline 2019-11-27T19:35:39.289882+0000) 2019-11-27T19:35:46.692 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:46.686+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:46.693 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:46.688+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:46.711 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:46.706+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:47.233 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:47.228+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:47.494 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:47.489+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:47.515 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:47.510+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:47.664 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:47.659+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:47.721 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:47.714+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:47.721 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:47.716+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:48.198 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:48.193+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:48.503 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:48.497+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:48.549 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:48.543+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:48.686 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:48.680+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:48.687 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:48.681+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:48.704 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:48.698+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:49.187 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:49.182+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:49.475 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:49.470+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:49.561 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:49.554+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:49.700 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:49.694+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:49.714 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:49.706+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:49.715 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:49.709+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:50.192 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:50.186+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:50.489 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:50.484+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:50.563 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:50.556+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:50.749 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:50.741+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:50.765 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:50.758+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:50.770 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:50.763+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:51.227 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:51.222+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:51.505 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:51.500+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:51.525 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:51.518+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:51.702 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:51.696+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:51.819 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:51.814+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:51.821 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:51.816+0000 1694c700 -1 osd.7 248 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:52.231 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:52.223+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:52.509 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:52.505+0000 1694c700 -1 osd.6 249 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:52.515 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:52.511+0000 1694c700 -1 osd.2 249 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:52.708 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:52.703+0000 1694c700 -1 osd.0 249 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:52.799 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:52.793+0000 1694c700 -1 osd.7 249 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:52.800 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:52.794+0000 1694c700 -1 osd.7 249 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:53.268 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:53.261+0000 1694c700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:53.526 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:53.473+0000 1694c700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:53.581 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:53.575+0000 1694c700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:53.737 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:53.722+0000 1694c700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:53.830 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:53.817+0000 1694c700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:53.830 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:53.818+0000 1694c700 -1 osd.7 250 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:54.447 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:54.408+0000 1694c700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:54.505 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:54.497+0000 1694c700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:54.708 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:54.651+0000 1694c700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:54.738 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:54.734+0000 1694c700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:54.799 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:54.786+0000 1694c700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:55.122 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:54.995+0000 1694c700 -1 osd.7 251 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:55.523 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:55.507+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:55.590 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:55.585+0000 1694c700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:55.698 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:55.684+0000 1694c700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:56.101 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:55.900+0000 1694c700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:56.704 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:56.697+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:56.712 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:56.697+0000 1694c700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:56.736 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:56.724+0000 1694c700 -1 osd.7 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:56.918 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:56.852+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:57.051 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:57.046+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:57.579 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:57.534+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:57.707 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:57.702+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:57.707 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:57.703+0000 1694c700 -1 osd.7 253 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:57.725 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:57.703+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:57.952 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:57.948+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:58.041 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:58.029+0000 1694c700 -1 osd.3 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:58.688 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:58.683+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:58.689 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:58.684+0000 1694c700 -1 osd.7 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:58.784 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:58.780+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:58.919 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:58.796+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:58.929 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:58.924+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:35:59.137 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:35:59.133+0000 1694c700 -1 osd.3 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:35:59.725 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:59.718+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:35:59.726 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:35:59.721+0000 1694c700 -1 osd.7 254 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:35:59.762 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:35:59.749+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:35:59.901 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:35:59.877+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:35:59.949 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:35:59.928+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:00.140 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:00.134+0000 1694c700 -1 osd.3 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:00.681 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:00.675+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:00.682 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:00.677+0000 1694c700 -1 osd.7 254 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:00.832 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:00.826+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:00.893 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:00.888+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:00.981 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:00.977+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:01.164 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:01.159+0000 1694c700 -1 osd.3 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:01.734 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:01.727+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:01.735 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:01.728+0000 1694c700 -1 osd.7 254 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:01.881 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:01.876+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:02.025 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:01.972+0000 1694c700 -1 osd.0 255 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:02.107 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:02.073+0000 1694c700 -1 osd.2 255 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:02.208 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:02.203+0000 1694c700 -1 osd.3 254 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:02.741 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:02.734+0000 1694c700 -1 osd.7 255 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:02.742 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:02.737+0000 1694c700 -1 osd.7 255 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:02.841 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:02.835+0000 1694c700 -1 osd.6 255 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:02.996 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:02.991+0000 1694c700 -1 osd.0 255 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:03.097 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:03.092+0000 1694c700 -1 osd.2 255 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:03.228 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:03.198+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:03.727 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:03.722+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:03.728 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:03.723+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:03.866 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:03.853+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:03.999 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:03.992+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:04.062 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:04.057+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:04.224 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:04.218+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:04.760 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:04.754+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:04.760 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:04.756+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:04.858 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:04.852+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:04.968 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:04.964+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:05.101 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:05.096+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:05.200 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:05.195+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:05.811 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:05.805+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:05.812 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:05.807+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:05.903 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:05.897+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:05.986 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:05.979+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:06.178 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:06.166+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:06.221 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:06.215+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:06.820 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:06.813+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:06.821 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:06.816+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:06.868 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:06.862+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:07.033 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:07.027+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:07.154 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:07.148+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:07.219 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:07.213+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:07.837 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:07.830+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:07.838 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:07.832+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:07.899 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:07.893+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:08.026 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:08.020+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:08.163 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:08.157+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:08.179 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:08.174+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:08.824 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:08.818+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:08.825 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:08.820+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:08.947 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:08.942+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:08.994 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:08.987+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:09.178 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:09.173+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:09.216 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:09.211+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:09.844 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:09.838+0000 1694c700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:09.845 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:09.840+0000 1694c700 -1 osd.7 256 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:09.924 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:09.918+0000 1694c700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:09.988 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:09.982+0000 1694c700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:10.226 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:10.170+0000 1694c700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:10.240 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:10.235+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:10.863 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:10.858+0000 1694c700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:10.864 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:10.859+0000 1694c700 -1 osd.7 257 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:11.003 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:10.942+0000 1694c700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:11.141 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:11.055+0000 1694c700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:11.204 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:11.199+0000 1694c700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:11.239 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:11.235+0000 1694c700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:11.816 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:36:11.812+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 42sec e248 v248) 2019-11-27T19:36:11.837 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:11.828+0000 1694c700 -1 osd.7 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:11.844 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:11.830+0000 1694c700 -1 osd.7 258 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:12.115 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:12.108+0000 1694c700 -1 osd.6 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:12.230 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:12.158+0000 1694c700 -1 osd.0 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:12.241 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:12.199+0000 1694c700 -1 osd.2 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:12.298 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:12.292+0000 1694c700 -1 osd.3 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:12.923 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:12.913+0000 1694c700 -1 osd.7 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:12.924 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:12.915+0000 1694c700 -1 osd.7 258 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:13.169 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:13.164+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:13.236 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:13.153+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:13.258 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:13.241+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:13.307 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:13.302+0000 1694c700 -1 osd.3 258 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:13.930 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:13.918+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:13.937 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:13.920+0000 1694c700 -1 osd.7 259 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:14.176 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:14.170+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:14.277 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:14.272+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:14.347 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:14.338+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:14.476 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:14.390+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:14.958 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:14.953+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:14.959 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:14.954+0000 1694c700 -1 osd.7 260 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:15.224 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:15.207+0000 1694c700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:15.372 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:15.357+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:15.431 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:15.362+0000 1694c700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:15.520 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:15.481+0000 1694c700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:15.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:15.985+0000 1694c700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:57.888612+0000 front 2019-11-27T19:34:53.100935+0000 (oldest deadline 2019-11-27T19:35:36.746495+0000) 2019-11-27T19:36:15.990 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:15.986+0000 1694c700 -1 osd.7 261 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:16.187 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:16.181+0000 1694c700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:16.400 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:36:16.391+0000 1694c700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.851127+0000 front 2019-11-27T19:34:56.853440+0000 (oldest deadline 2019-11-27T19:35:37.224202+0000) 2019-11-27T19:36:16.418 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:36:16.412+0000 1694c700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.059303+0000 front 2019-11-27T19:34:56.105363+0000 (oldest deadline 2019-11-27T19:35:38.804367+0000) 2019-11-27T19:36:16.606 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:16.589+0000 1694c700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:55.977171+0000 front 2019-11-27T19:34:56.503584+0000 (oldest deadline 2019-11-27T19:35:36.305721+0000) 2019-11-27T19:36:16.870 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:36:16.859+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 42sec e248 v248) 2019-11-27T19:36:17.155 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:36:17.148+0000 1694c700 -1 osd.2 262 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:34:56.852911+0000 front 2019-11-27T19:34:55.520953+0000 (oldest deadline 2019-11-27T19:35:39.421618+0000) 2019-11-27T19:36:17.246 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:17.239+0000 1694c700 -1 osd.7 263 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:18.409 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:18.369+0000 1694c700 -1 osd.7 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:19.497 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:19.449+0000 1694c700 -1 osd.7 265 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:20.636 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:20.595+0000 1694c700 -1 osd.7 266 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:21.827 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:21.805+0000 1694c700 -1 osd.7 267 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:22.783 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:22.768+0000 1694c700 -1 osd.7 267 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:23.820 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:23.812+0000 1694c700 -1 osd.7 268 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:24.863 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:24.843+0000 1694c700 -1 osd.7 268 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:25.883 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:25.878+0000 1694c700 -1 osd.7 269 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:26.913 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:26.893+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:27.893 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:27.888+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:28.882 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:28.877+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:29.926 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:29.922+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:31.026 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:31.013+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:32.098 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:32.087+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:33.087 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:33.067+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:34.121 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:34.116+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:34.510 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:42:08.572 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.517 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:42:08.579 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.526 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:42:08.588 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.528 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:42:08.590 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.535 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:42:08.544 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.538 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:42:08.547 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.868 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:42:08.930 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.872 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:42:08.881 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:34.924 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:42:08.983 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:35.152 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:35.145+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:36.196 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:36.161+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:37.160 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:37.156+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:38.191 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:38.184+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:39.199 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:39.193+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:40.190 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:40.183+0000 1694c700 -1 osd.7 270 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:41.171 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:41.162+0000 1694c700 -1 osd.7 271 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:42.157 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:42.152+0000 1694c700 -1 osd.7 272 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:43.174 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:43.159+0000 1694c700 -1 osd.7 273 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:44.135 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:44.130+0000 1694c700 -1 osd.7 273 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:45.188 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:45.182+0000 1694c700 -1 osd.7 274 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:46.187 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:46.181+0000 1694c700 -1 osd.7 275 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:47.221 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:47.215+0000 1694c700 -1 osd.7 275 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:47.646 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:47.640+0000 1694c700 -1 osd.6 275 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:48.268 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:36:48.252+0000 1694c700 -1 osd.7 276 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4361.0:112942 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 5443828736 gen 1] snapc 0=[] ondisk+write+known_if_redirected e247) 2019-11-27T19:36:48.632 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:36:48.614+0000 20e22700 -1 RGWWatcher::handle_error cookie 5443828736 err (107) Transport endpoint is not connected 2019-11-27T19:36:48.774 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:48.737+0000 1694c700 -1 osd.6 276 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:49.991 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:49.962+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:51.008 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:51.002+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:52.041 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:52.035+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:52.152 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:42:26.214 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.209 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:42:26.271 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.236 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:42:26.298 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.249 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:42:26.310 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.268 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:42:26.277 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.270 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:42:26.279 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.310 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:42:26.372 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.320 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:42:26.382 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:52.349 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:42:26.358 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:53.022 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:53.018+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:54.008 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:54.003+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:55.021 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:55.016+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:56.036 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:56.031+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:57.021 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:57.014+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:58.048 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:58.042+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:36:59.042 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:36:59.036+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:00.027 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:00.022+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:01.071 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:01.066+0000 1694c700 -1 osd.6 277 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:02.212 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:02.126+0000 1694c700 -1 osd.6 278 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:03.173 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:03.166+0000 1694c700 -1 osd.6 279 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:04.140 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:04.131+0000 1694c700 -1 osd.6 279 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:05.164 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:05.154+0000 1694c700 -1 osd.6 280 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:06.181 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:06.173+0000 1694c700 -1 osd.6 281 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:07.158 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:07.153+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:08.198 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:08.162+0000 1694c700 -1 osd.6 283 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:09.236 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:09.221+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:10.352 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:10.306+0000 1694c700 -1 osd.6 285 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:11.393 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:11.362+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:12.408 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:12.404+0000 1694c700 -1 osd.6 287 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:13.396 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:13.389+0000 1694c700 -1 osd.6 287 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:37:14.443 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:37:14.438+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:109614 7.d 7.d14bf92d (undecoded) ondisk+retry+write+known_if_redirected e263) 2019-11-27T19:38:08.084 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:08.079+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:09.072 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:09.068+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:10.097 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:10.092+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:11.054 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:11.049+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:11.663 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:11.657+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:12.029 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:12.023+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:12.100 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:12.094+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:12.103 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:12.098+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:12.284 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:12.279+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:12.303 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:12.298+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:12.672 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:12.666+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:13.020 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:13.013+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:13.035 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:13.029+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:13.107 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:13.100+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:13.107 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:13.103+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:13.250 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:13.244+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:13.283 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:13.276+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:13.656 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:13.650+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:14.043 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:14.038+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:14.047 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:14.042+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:14.109 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:14.104+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:14.112 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:14.108+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:14.242 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:14.236+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:14.265 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:14.259+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:14.692 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:14.688+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:15.021 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:15.015+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:15.048 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:15.042+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:15.158 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:15.153+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:15.158 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:15.154+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:15.229 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:15.221+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:15.242 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:15.235+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:15.719 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:15.713+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:15.989 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:15.983+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:16.020 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:16.014+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:16.146 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:16.140+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:16.147 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:16.142+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:16.236 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:16.231+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:16.236 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:16.231+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:16.701 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:16.697+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:16.956 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:16.950+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:17.070 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:17.065+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:17.198 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:17.192+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:17.201 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:17.194+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:17.211 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:17.205+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:17.239 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:17.234+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:17.673 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:17.669+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:17.954 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:17.948+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:18.059 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:18.055+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:18.203 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:18.198+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:18.209 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:18.203+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:18.212 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:18.207+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:18.251 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:18.245+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:18.704 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:18.699+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:18.980 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:18.973+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:19.047 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:19.041+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:19.175 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:19.168+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:19.175 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:19.169+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:19.253 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:19.248+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:19.258 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:19.251+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:19.745 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:19.739+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:20.007 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:19.999+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:20.041 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:20.036+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:20.204 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:20.198+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:20.207 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:20.201+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:20.234 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:20.227+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:20.305 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:20.299+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:20.730 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:20.724+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:21.005 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:20.999+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:21.059 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:21.052+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:21.213 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:21.206+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:21.255 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:21.247+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:21.260 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:21.249+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:21.261 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:21.256+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:21.709 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:21.703+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:22.011 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:22.004+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:22.091 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:22.086+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:22.174 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:22.168+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:22.278 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:22.273+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:22.281 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:22.275+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:22.281 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:22.277+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:22.666 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:22.661+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:23.035 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:23.029+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:23.082 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:23.076+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:23.150 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:23.145+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:23.236 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:23.231+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:23.295 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:23.290+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:23.296 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:23.291+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:23.647 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:23.641+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:24.034 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:24.028+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:24.043 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:24.035+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:24.135 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:24.129+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:24.212 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:24.207+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:24.289 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:24.283+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:24.290 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:24.285+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:24.665 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:24.659+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:25.022 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:25.015+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:25.035 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:25.029+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:25.099 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:25.093+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:25.258 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:25.253+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:25.326 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:25.319+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:25.327 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:25.321+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:25.632 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:25.627+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:26.042 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:26.036+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:26.056 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:26.049+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:26.115 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:26.110+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:26.211 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:26.206+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:26.370 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:26.364+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:26.371 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:26.366+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:26.674 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:26.670+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:27.026 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:27.021+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:27.094 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:27.088+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:27.128 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:27.122+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:27.235 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:27.229+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:27.389 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:27.384+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:27.392 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:27.387+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:27.717 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:27.711+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:28.057 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:28.046+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:28.078 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:28.072+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:28.095 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:28.089+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:28.269 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:28.263+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:28.351 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:28.344+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:28.352 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:28.346+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:28.730 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:28.722+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:29.036 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:29.030+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:29.075 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:29.069+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:29.105 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:29.100+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:29.294 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:29.289+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:29.390 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:29.383+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:29.391 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:29.385+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:29.720 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:29.716+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:30.083 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:30.078+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:30.106 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:30.101+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:30.112 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:30.107+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:30.342 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:30.337+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:30.442 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:30.436+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:30.443 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:30.439+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:30.685 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:30.680+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:31.074 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:31.068+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:31.125 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:31.119+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:31.133 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:31.128+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:31.315 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:31.310+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:31.484 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:31.478+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:31.485 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:31.479+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:31.720 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:31.715+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:32.081 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:32.075+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:32.096 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:32.090+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:32.103 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:32.097+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:32.308 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:32.302+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:32.450 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:32.444+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:32.451 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:32.446+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:32.767 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:32.763+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:33.070 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:33.066+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:33.084 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:33.079+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:33.134 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:33.129+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:33.316 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:33.311+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:33.457 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:33.452+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:33.459 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:33.455+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:33.822 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:33.817+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:34.046 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:34.040+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:34.118 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:34.112+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:34.125 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:34.119+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:34.289 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:34.283+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:34.474 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:34.468+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:34.475 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:34.469+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:34.814 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:34.809+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:35.021 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:35.017+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:35.101 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:35.095+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:35.151 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:35.145+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:35.293 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:35.287+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:35.475 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:35.470+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:35.478 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:35.473+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:35.831 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:35.825+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:36.030 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:36.025+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:36.121 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:36.115+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:36.188 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:36.182+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:36.277 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:36.266+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:36.527 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:36.521+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:36.531 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:36.526+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:36.867 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:36.861+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:37.003 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:36.998+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:37.139 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:37.134+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:37.149 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:37.143+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:37.249 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:37.242+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:37.569 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:37.560+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:37.570 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:37.562+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:37.867 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:37.863+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:38.027 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:38.021+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:38.177 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:38.171+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:38.207 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:38.199+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:38.290 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:38.285+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:38.605 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:38.597+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:38.610 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:38.600+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:38.921 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:38.915+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:39.054 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:39.048+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:39.157 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:39.152+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:39.236 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:39.231+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:39.302 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:39.297+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:39.635 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:39.628+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:39.636 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:39.630+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:39.980 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:39.967+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:40.103 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:40.097+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:40.204 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:40.198+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:40.205 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:40.200+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:40.361 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:40.356+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:40.658 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:40.653+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:40.659 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:40.654+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:40.945 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:40.939+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:41.134 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:41.129+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:41.234 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:41.229+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:41.257 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:41.251+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:41.339 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:41.332+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:41.680 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:41.675+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:41.683 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:41.678+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:41.943 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:41.938+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:42.161 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:42.155+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:42.230 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:42.224+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:42.278 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:42.273+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:42.309 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:42.301+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:42.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:38:42.528+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 43sec e302 v302) 2019-11-27T19:38:42.641 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:42.634+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:42.643 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:42.636+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:42.933 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:42.927+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:43.194 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:43.189+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:43.281 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:43.275+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:43.306 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:43.300+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:43.329 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:43.319+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:43.632 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:43.624+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:43.637 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:43.627+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:43.934 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:43.928+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:44.226 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:44.213+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:44.321 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:44.315+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:44.327 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:44.320+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:44.349 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:44.342+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:44.637 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:44.631+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:44.639 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:44.633+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:44.980 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:44.974+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:45.188 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:45.183+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:45.337 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:45.330+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:45.370 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:45.365+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:45.378 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:45.371+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:45.669 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:45.662+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:45.670 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:45.665+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:46.005 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:45.998+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:46.150 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:46.144+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:46.349 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:46.343+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:46.359 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:46.353+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:46.377 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:46.371+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:46.670 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:46.665+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:46.671 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:46.666+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:46.983 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:46.976+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:47.171 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:47.164+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:47.322 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:47.316+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:47.382 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:47.376+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:47.409 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:47.403+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:47.571 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:38:47.561+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 43sec e302 v302) 2019-11-27T19:38:47.709 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:47.703+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:47.712 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:47.707+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:48.009 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:48.003+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:48.146 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:48.140+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:48.337 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:48.332+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:48.412 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:48.407+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:48.451 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:48.444+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:48.703 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:48.696+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:48.704 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:48.699+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:49.035 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:49.029+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:49.146 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:49.140+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:49.333 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:49.329+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:49.429 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:49.423+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:49.477 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:49.471+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:49.667 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:49.659+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:49.672 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:49.661+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:50.070 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:50.064+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:50.196 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:50.191+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:50.309 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:50.304+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:50.444 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:50.438+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:50.461 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:50.455+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:50.672 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:50.665+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:50.674 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:50.668+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:51.114 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:51.108+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:51.240 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:51.234+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:51.333 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:51.327+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:51.433 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:51.427+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:51.492 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:51.486+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:51.718 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:51.711+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:51.720 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:51.714+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:52.104 INFO:tasks.ceph.osd.0.smithi005.stderr:2019-11-27T19:38:52.098+0000 1694c700 -1 osd.0 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:26.433150+0000 front 2019-11-27T19:37:31.078561+0000 (oldest deadline 2019-11-27T19:38:11.046010+0000) 2019-11-27T19:38:52.280 INFO:tasks.ceph.osd.6.smithi115.stderr:2019-11-27T19:38:52.274+0000 1694c700 -1 osd.6 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:30.356672+0000 front 2019-11-27T19:37:30.355452+0000 (oldest deadline 2019-11-27T19:38:11.612823+0000) 2019-11-27T19:38:52.335 INFO:tasks.ceph.osd.3.smithi005.stderr:2019-11-27T19:38:52.330+0000 1694c700 -1 osd.3 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.686927+0000 front 2019-11-27T19:37:28.036075+0000 (oldest deadline 2019-11-27T19:38:11.426258+0000) 2019-11-27T19:38:52.461 INFO:tasks.ceph.osd.2.smithi005.stderr:2019-11-27T19:38:52.455+0000 1694c700 -1 osd.2 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.938782+0000 front 2019-11-27T19:37:27.546591+0000 (oldest deadline 2019-11-27T19:38:12.234923+0000) 2019-11-27T19:38:52.511 INFO:tasks.ceph.osd.5.smithi115.stderr:2019-11-27T19:38:52.505+0000 1694c700 -1 osd.5 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:29.413915+0000 front 2019-11-27T19:37:28.565069+0000 (oldest deadline 2019-11-27T19:38:11.105682+0000) 2019-11-27T19:38:52.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2019-11-27T19:38:52.626+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.115:6808/9157,v1:172.21.15.115:6809/9157] for 43sec e302 v302) 2019-11-27T19:38:52.723 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:52.717+0000 1694c700 -1 osd.7 302 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2019-11-27T19:37:27.937480+0000 front 2019-11-27T19:37:27.052677+0000 (oldest deadline 2019-11-27T19:38:12.014048+0000) 2019-11-27T19:38:52.725 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:52.720+0000 1694c700 -1 osd.7 302 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:53.707 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:53.702+0000 1694c700 -1 osd.7 303 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:54.751 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:54.744+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:55.758 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:55.753+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:56.782 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:56.777+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:57.780 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:57.775+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:58.792 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:58.787+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:38:59.747 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:38:59.742+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:00.787 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:00.781+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:01.798 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:01.792+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:02.819 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:02.813+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:03.793 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:03.788+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:04.761 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:04.755+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:05.776 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:05.770+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:06.821 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:06.815+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:07.795 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:07.789+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:08.841 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:08.834+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:09.890 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:09.883+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:10.850 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:10.842+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:11.832 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:11.826+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:12.860 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:12.854+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:13.887 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:13.881+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:14.908 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:14.903+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:15.892 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:15.886+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:16.866 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:16.860+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:17.847 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:17.843+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:18.807 INFO:tasks.ceph.osd.7.smithi115.stderr:2019-11-27T19:39:18.802+0000 1694c700 -1 osd.7 304 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4361.0:113246 5.5 5:a93a5511:::notify.2:head [watch ping cookie 1049836960 gen 1] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-11-27T19:39:19.583 INFO:tasks.rgw.client.0.smithi005.stdout:2019-11-27T19:39:19.577+0000 20e22700 -1 RGWWatcher::handle_error cookie 1049836960 err (107) Transport endpoint is not connected 2019-11-27T19:39:46.883 INFO:tasks.ceph.osd.4.smithi115.stderr:*** Caught signal (Aborted) ** 2019-11-27T19:39:46.883 INFO:tasks.ceph.osd.4.smithi115.stderr: in thread 3a27d700 thread_name:tp_osd_tp 2019-11-27T19:39:47.304 INFO:tasks.ceph.osd.4.smithi115.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T19:39:47.305 INFO:tasks.ceph.osd.4.smithi115.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T19:39:47.305 INFO:tasks.ceph.osd.4.smithi115.stderr: 2: (()+0xe50d) [0xc09a50d] 2019-11-27T19:39:47.305 INFO:tasks.ceph.osd.4.smithi115.stderr: 3: (()+0x9e5b) [0xc095e5b] 2019-11-27T19:39:47.305 INFO:tasks.ceph.osd.4.smithi115.stderr: 4: (pthread_mutex_lock()+0x68) [0xc095d28] 2019-11-27T19:39:47.305 INFO:tasks.ceph.osd.4.smithi115.stderr: 5: (ceph::mutex_debug_detail::mutex_debug_impl::lock(bool)+0x57) [0x71d937] 2019-11-27T19:39:47.306 INFO:tasks.ceph.osd.4.smithi115.stderr: 6: (PG::lock(bool) const+0x2d) [0x77160d] 2019-11-27T19:39:47.306 INFO:tasks.ceph.osd.4.smithi115.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x242) [0x6f67e2] 2019-11-27T19:39:47.306 INFO:tasks.ceph.osd.4.smithi115.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T19:39:47.306 INFO:tasks.ceph.osd.4.smithi115.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T19:39:47.306 INFO:tasks.ceph.osd.4.smithi115.stderr: 10: (()+0x7e65) [0xc093e65] 2019-11-27T19:39:47.306 INFO:tasks.ceph.osd.4.smithi115.stderr: 11: (clone()+0x6d) [0xd20b88d] 2019-11-27T19:39:50.064 INFO:tasks.ceph.osd.4.smithi115.stderr:daemon-helper: command crashed with signal 6 2019-11-27T19:39:54.762 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:45:28.823 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:54.776 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:45:28.838 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:54.784 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:45:28.846 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:54.790 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:45:28.852 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:54.795 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:45:28.804 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:54.820 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:45:28.829 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:55.067 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:45:29.129 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:55.126 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:45:29.187 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:39:55.149 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:45:29.158 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.513 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:46:52.574 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.574 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:46:52.635 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.607 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:46:52.615 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.612 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:46:52.621 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.634 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:46:52.696 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.638 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:46:52.700 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.756 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:46:52.818 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.796 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:46:52.805 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:18.810 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:46:52.871 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.407 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:50:38.469 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.412 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:50:38.474 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.425 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:50:38.486 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.433 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:50:38.442 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.434 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:50:38.496 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.452 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:50:38.460 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.607 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:50:38.668 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.628 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:50:38.690 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:04.805 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:50:38.814 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.489 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:50:48.551 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.543 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:50:48.604 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.576 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:50:48.585 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.577 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:50:48.639 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.582 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:50:48.644 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.585 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:50:48.647 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.585 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:50:48.594 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.609 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:50:48.671 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:14.612 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:50:48.621 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.479 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:55:23.541 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.507 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:55:23.568 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.516 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:55:23.525 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.527 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:55:23.588 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.527 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:55:23.535 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.530 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:55:23.592 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.804 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:55:23.865 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.805 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:55:23.814 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:49:49.863 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:55:23.924 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.516 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:59:10.578 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.520 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:59:10.582 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.557 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:59:10.619 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.559 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:59:10.621 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.588 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:59:10.597 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.599 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:59:10.604 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.780 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:59:10.842 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.855 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:59:10.916 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:36.917 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:59:10.926 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.498 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:59:19.560 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.503 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:59:19.565 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.517 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:59:19.577 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.520 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:59:19.582 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.527 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:59:19.535 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.535 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:59:19.543 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.545 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:06:59:19.607 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.558 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:06:59:19.619 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:45.635 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:06:59:19.643 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.327 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:04:31.388 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.336 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:04:31.398 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.360 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:04:31.369 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.361 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:04:31.423 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.368 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:04:31.430 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.388 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:04:31.397 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.544 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:04:31.606 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.561 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:04:31.623 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:57.723 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:04:31.732 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.457 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:07:32.519 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.491 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:07:32.547 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.496 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:07:32.558 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.502 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:07:32.564 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.543 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:07:32.552 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.546 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:07:32.555 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.584 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:07:32.646 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.636 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:07:32.698 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:58.672 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:07:32.681 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.350 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:09:41.411 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.354 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:09:41.416 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.367 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:09:41.429 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.371 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:09:41.380 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.373 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:09:41.436 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.379 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:09:41.388 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.454 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:09:41.516 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.481 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:09:41.543 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:04:07.557 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:09:41.565 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.120 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:14:54.182 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.141 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:14:54.189 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.159 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:14:54.168 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.169 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:14:54.178 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.253 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:14:54.316 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.256 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:14:54.319 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.395 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:14:54.457 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.430 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:14:54.438 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:09:20.484 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:14:54.546 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:15:59.355 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.314 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:15:59.376 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.329 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:15:59.391 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.343 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:15:59.405 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.393 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:15:59.456 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.409 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:15:59.471 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.412 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:15:59.421 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.416 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:15:59.425 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:25.546 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:15:59.555 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.168 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:19:35.231 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.191 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:19:35.237 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.207 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:19:35.269 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.238 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:19:35.300 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.288 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:19:35.297 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.291 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:19:35.301 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.321 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:19:35.383 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.444 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:19:35.507 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:01.521 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:19:35.530 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.494 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:20:04.556 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.502 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:20:04.565 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.517 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:20:04.574 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.523 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:20:04.532 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.529 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:20:04.591 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.534 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:20:04.543 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.555 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:20:04.618 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.595 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:20:04.657 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:14:30.640 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:20:04.649 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.243 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:24:21.305 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.252 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:24:21.311 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.289 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:24:21.351 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.291 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:24:21.353 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.311 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:24:21.320 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.313 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:24:21.322 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.427 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:24:21.489 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.447 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:24:21.509 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:47.461 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:24:21.470 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.581 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:25:16.644 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.586 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:25:16.648 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.602 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:25:16.664 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.603 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:25:16.613 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.609 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:25:16.671 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.610 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:25:16.619 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.655 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:25:16.717 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.662 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:25:16.724 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:19:42.745 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:25:16.754 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:54.851 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:30:28.914 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:30:28.923 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:54.873 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:30:28.935 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:54.877 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:30:28.939 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:54.882 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:30:28.891 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:54.889 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:30:28.898 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:55.056 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:30:29.118 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:55.071 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:30:29.133 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:24:55.097 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:30:29.106 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.026 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:32:43.088 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.039 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:32:43.101 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.078 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:32:43.140 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.079 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:32:43.142 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.119 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:32:43.128 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.133 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:32:43.139 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.148 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:32:43.211 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.158 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:32:43.220 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:27:09.275 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:32:43.285 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.103 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:35:42.166 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.110 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:35:42.173 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.120 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:35:42.182 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.126 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:35:42.189 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.134 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:35:42.143 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.152 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:35:42.161 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.227 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:35:42.290 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.279 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:35:42.341 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:30:08.380 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:35:42.389 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.594 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:40:54.656 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.618 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:40:54.663 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.618 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:40:54.675 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.624 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:40:54.687 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.625 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:40:54.634 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.661 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:40:54.671 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.842 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:40:54.905 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.861 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:40:54.923 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:20.918 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:40:54.928 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.633 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:41:04.696 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:41:04.705 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.673 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:41:04.736 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.681 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:41:04.744 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.715 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:41:04.778 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.727 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:41:04.737 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.730 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:41:04.740 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.748 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:41:04.811 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:35:30.761 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:41:04.771 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.770 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:46:05.833 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.780 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:46:05.840 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.783 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:46:05.846 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.787 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:46:05.850 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.797 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:46:05.806 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.806 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:46:05.816 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:31.972 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:46:06.035 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:32.109 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:46:06.172 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:40:32.136 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:46:06.146 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.328 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:49:26.391 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.341 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:49:26.394 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.377 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:49:26.440 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.379 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:49:26.442 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.413 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:49:26.423 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.420 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:49:26.430 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.468 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:49:26.531 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.474 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:49:26.537 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:52.540 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:49:26.550 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.862 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:51:17.925 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.869 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:51:17.933 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.874 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:51:17.938 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.883 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:51:17.946 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.889 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:51:17.899 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.909 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:51:17.920 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:43.993 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:51:18.056 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:44.003 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:51:18.066 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:45:44.033 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:51:18.044 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:56.769 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:56:30.832 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:56.778 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:56:30.838 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:56.784 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:56:30.847 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:56.793 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:56:30.857 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:56.800 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:56:30.810 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:56.807 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:56:30.818 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:57.025 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:56:31.089 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:57.027 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:56:31.091 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:50:57.139 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:56:31.150 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.043 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:57:48.106 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.047 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:57:48.110 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.082 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:57:48.145 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.084 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:57:48.148 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.136 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:57:48.146 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.142 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:07:57:48.205 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.147 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:57:48.156 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.163 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:07:57:48.226 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:14.235 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:07:57:48.245 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:29.948 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:01:04.012 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:29.983 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:01:04.046 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.017 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:01:04.080 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.018 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:01:04.082 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.058 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:01:04.068 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.060 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:01:04.071 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.146 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:01:04.210 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.206 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:01:04.269 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:55:30.210 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:01:04.221 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.260 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:01:39.324 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.265 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:01:39.329 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.286 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:01:39.349 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.288 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:01:39.299 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.291 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:01:39.354 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.296 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:01:39.307 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.312 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:01:39.375 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.352 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:01:39.415 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T20:56:05.391 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:01:39.401 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.055 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:06:10.118 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.076 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:06:10.123 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.093 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:06:10.156 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.094 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:06:10.158 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.139 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:06:10.149 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.141 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:06:10.152 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.218 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:06:10.281 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.300 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:06:10.311 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:36.320 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:06:10.381 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.481 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:06:48.545 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.497 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:06:48.560 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.503 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:06:48.514 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.507 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:06:48.571 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.508 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:06:48.519 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.518 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:06:48.581 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.552 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:06:48.616 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.589 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:06:48.652 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:01:14.610 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:06:48.621 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.620 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:11:58.684 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.650 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:11:58.697 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.650 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:11:58.712 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.654 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:11:58.717 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.667 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:11:58.678 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.690 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:11:58.701 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.862 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:11:58.925 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.872 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:11:58.935 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:06:24.950 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:11:58.961 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:57.887 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:14:31.951 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:57.895 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:14:31.959 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:57.942 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:14:32.006 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:57.946 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:14:32.010 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:57.963 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:14:31.974 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:57.972 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:14:31.983 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:58.023 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:14:32.086 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:58.078 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:14:32.089 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:58.118 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:14:32.181 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.862 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:17:10.926 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.866 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:17:10.930 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.880 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:17:10.944 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.884 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:17:10.948 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.892 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:17:10.903 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.900 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:17:10.911 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:36.987 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:17:11.051 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:37.023 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:17:11.086 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:11:37.153 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:17:11.164 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.157 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:22:23.221 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.169 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:22:23.233 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.181 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:22:23.245 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.189 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:22:23.201 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.195 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:22:23.259 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.201 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:22:23.212 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.421 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:22:23.485 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.422 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:22:23.486 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:16:49.486 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:22:23.497 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.876 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:22:53.939 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.881 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:22:53.945 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.912 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:22:53.976 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.918 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:22:53.982 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.922 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:22:53.986 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.948 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:22:54.012 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.968 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:22:53.979 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:19.971 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:22:53.982 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:20.025 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:22:54.036 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.225 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:27:33.289 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.234 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:27:33.298 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.243 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:27:33.307 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.253 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:27:33.264 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.257 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:27:33.321 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.269 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:27:33.280 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.410 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:27:33.474 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.437 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:27:33.501 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:21:59.503 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:27:33.515 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.661 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:31:15.725 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.670 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:31:15.734 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.725 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:31:15.789 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.728 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:31:15.792 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.756 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:31:15.767 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.760 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:31:15.771 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.807 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:31:15.870 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.833 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:31:15.897 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:41.876 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:31:15.887 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.336 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:32:45.400 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.344 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:32:45.408 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.353 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:32:45.417 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.357 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:32:45.421 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.371 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:32:45.382 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.389 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:32:45.400 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.427 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:32:45.491 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.432 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:32:45.496 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:27:11.540 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:32:45.551 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.133 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:38:02.197 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.150 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:38:02.209 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.158 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:38:02.222 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.168 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:38:02.233 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.175 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:38:02.187 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.214 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:38:02.226 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.376 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:38:02.440 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.385 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:38:02.449 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:32:28.439 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:38:02.451 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.473 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:39:37.537 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.477 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:39:37.541 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.539 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:39:37.550 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.543 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:39:37.555 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.544 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:39:37.608 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.548 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:39:37.613 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.576 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:39:37.640 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.614 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:39:37.626 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:03.636 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:39:37.700 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.119 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:41:43.183 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.143 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:41:43.185 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.166 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:41:43.230 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.177 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:41:43.241 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.221 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:41:43.285 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.229 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:41:43.241 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.235 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:41:43.244 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.278 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:41:43.342 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:36:09.350 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:41:43.361 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.448 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:43:13.513 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.455 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:43:13.519 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.484 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:43:13.496 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.496 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:43:13.561 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.499 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:43:13.564 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.508 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:43:13.520 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.552 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:43:13.616 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.573 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:43:13.637 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:37:39.696 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:43:13.707 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.395 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:47:59.459 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.456 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:47:59.520 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.499 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:47:59.564 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.502 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:47:59.566 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.530 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:47:59.541 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.532 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:47:59.544 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.607 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:47:59.671 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.666 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:47:59.730 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:25.709 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:47:59.721 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.587 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:48:24.651 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.595 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:48:24.660 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.605 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:48:24.669 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.610 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:48:24.674 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.621 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:48:24.633 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.641 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:48:24.705 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.653 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:48:24.717 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.656 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:48:24.668 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:50.754 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:48:24.766 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.612 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:53:36.676 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.619 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:53:36.684 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.628 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:53:36.692 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.632 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:53:36.696 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.656 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:53:36.667 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.673 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:53:36.685 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.807 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:53:36.871 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.826 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:53:36.890 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:48:02.870 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:53:36.882 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.097 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:56:21.161 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.116 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:56:21.180 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.123 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:56:21.187 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.128 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:56:21.140 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.141 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:56:21.205 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.160 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:56:21.172 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.241 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:56:21.305 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.261 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:56:21.326 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:47.271 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:56:21.282 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.727 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:58:46.791 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.737 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:58:46.801 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.747 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:58:46.811 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.753 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:58:46.817 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.759 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:58:46.771 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.769 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:58:46.781 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.896 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:08:58:46.960 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:12.908 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:08:58:46.973 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:53:13.004 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:08:58:47.015 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:24.785 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:03:58.849 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:24.810 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:03:58.856 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:24.812 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:03:58.876 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:24.816 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:03:58.880 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:24.820 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:03:58.831 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:24.869 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:03:58.880 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:25.028 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:03:59.092 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:25.056 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:03:59.121 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:58:25.201 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:03:59.213 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.843 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:04:42.907 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.892 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:04:42.956 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.894 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:04:42.958 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.898 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:04:42.962 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.932 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:04:42.944 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.939 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:04:43.003 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.940 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:04:42.952 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:08.941 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:04:43.006 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:09.010 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:04:43.022 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:35.745 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:09:09.803 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.281 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:09:09.787 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.281 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:09:09.798 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.281 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:09:10.035 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.281 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:09:09.813 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.282 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:09:10.031 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.282 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:09:09.822 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.282 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:09:09.827 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:03:36.282 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:09:10.002 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:13:04.660 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:13:04.711 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.655 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:13:04.719 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.660 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:13:04.724 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.676 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:13:04.688 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.685 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:13:04.697 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.768 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:13:04.833 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.867 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:13:04.879 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:30.884 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:13:04.949 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.104 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:14:21.168 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.109 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:14:21.173 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.119 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:14:21.183 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.125 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:14:21.189 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.130 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:14:21.142 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.147 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:14:21.159 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.178 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:14:21.242 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.190 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:14:21.254 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:08:47.307 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:14:21.319 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.155 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:19:32.219 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.222 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:19:32.211 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.222 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:19:32.225 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.222 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:19:32.227 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.223 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:19:32.234 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.223 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:19:32.245 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.366 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:19:32.430 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.427 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:19:32.491 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:13:58.525 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:19:32.538 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.425 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:21:26.490 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.428 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:21:26.493 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.501 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:21:26.566 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.503 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:21:26.568 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.528 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:21:26.593 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.549 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:21:26.561 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.557 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:21:26.569 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.572 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:21:26.636 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:52.638 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:21:26.650 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:52.964 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:22:27.029 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:52.969 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:22:27.033 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.031 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:22:27.095 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.057 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:22:27.121 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.063 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:22:27.127 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.074 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:22:27.086 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.076 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:22:27.089 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.133 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:22:27.197 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:16:53.145 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:22:27.157 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.541 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:24:42.605 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.547 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:24:42.611 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.556 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:24:42.621 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.560 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:24:42.624 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.567 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:24:42.580 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.574 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:24:42.586 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.711 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:24:42.775 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.716 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:24:42.779 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:19:08.778 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:24:42.790 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.404 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:29:48.469 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.435 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:29:48.495 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.455 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:29:48.468 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.462 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:29:48.475 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.466 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:29:48.530 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.470 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:29:48.534 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.570 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:29:48.635 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.615 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:29:48.680 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:14.639 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:29:48.652 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.723 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:29:53.787 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.732 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:29:53.796 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.742 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:29:53.806 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.750 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:29:53.814 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.759 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:29:53.772 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.778 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:29:53.842 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.778 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:29:53.842 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.785 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:29:53.797 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:19.850 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:29:53.862 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:33.869 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:35:07.934 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:33.878 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:35:07.943 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:33.893 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:35:07.957 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:33.897 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:35:07.961 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:33.904 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:35:07.915 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:33.918 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:35:07.930 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:34.088 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:35:08.152 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:34.091 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:35:08.155 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:29:34.144 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:35:08.156 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.143 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:38:10.207 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.149 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:38:10.213 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.189 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:38:10.253 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.192 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:38:10.256 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.220 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:38:10.232 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.228 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:38:10.241 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.249 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:38:10.314 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.309 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:38:10.373 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:36.356 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:38:10.368 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.071 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:40:20.135 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.076 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:40:20.141 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.087 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:40:20.151 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.090 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:40:20.155 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.101 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:40:20.113 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.140 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:40:20.152 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.182 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:40:20.247 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.196 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:40:20.261 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:34:46.316 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:40:20.327 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.705 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:45:31.770 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.732 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:45:31.778 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.732 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:45:31.788 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.732 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:45:31.793 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.734 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:45:31.746 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.741 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:45:31.754 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.921 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:45:31.985 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:57.933 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:45:31.997 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:58.042 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:45:32.055 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.873 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:46:31.938 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.920 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:46:31.985 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.951 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:46:31.964 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.957 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:46:31.970 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.970 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:46:32.034 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.973 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:46:32.038 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:57.977 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:46:32.041 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:58.030 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:46:32.043 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:40:58.043 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:46:32.107 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:08.818 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:50:42.882 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:08.836 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:50:42.893 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:08.836 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:50:42.901 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:08.843 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:50:42.907 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:08.849 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:50:42.861 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:08.869 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:50:42.881 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:09.020 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:50:43.084 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:09.090 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:50:43.155 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:45:09.111 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:50:43.123 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.638 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:54:53.702 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.679 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:54:53.743 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.707 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:54:53.771 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.708 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:54:53.773 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.723 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:54:53.735 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.729 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:54:53.741 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.877 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:54:53.941 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.880 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:54:53.945 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:19.923 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:54:53.936 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.000 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:55:55.064 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.011 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:55:55.075 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.035 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:55:55.099 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.037 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:55:55.049 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.045 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:55:55.109 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.048 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:55:55.060 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.113 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:09:55:55.177 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.130 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:09:55:55.194 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:21.197 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:09:55:55.209 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:35.951 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:01:10.015 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:35.968 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:01:10.020 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:35.969 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:01:10.030 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:35.974 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:01:10.037 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:35.988 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:01:10.000 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:36.000 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:01:10.012 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:36.190 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:01:10.253 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:36.263 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:01:10.326 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:55:36.293 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:01:10.304 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:03:20.484 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:03:20.493 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.470 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:03:20.533 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.504 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:03:20.563 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.504 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:03:20.566 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.515 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:03:20.526 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.517 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:03:20.530 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.564 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:03:20.627 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:46.687 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:03:20.699 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.777 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:03:55.840 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.813 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:03:55.877 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.827 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:03:55.891 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.832 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:03:55.896 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.863 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:03:55.926 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.881 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:03:55.944 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.895 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:03:55.908 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.899 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:03:55.912 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:21.982 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:03:55.994 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:44.964 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:06:19.028 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:44.976 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:06:19.039 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:44.984 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:06:19.048 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:44.987 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:06:19.051 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:44.996 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:06:19.008 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:45.013 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:06:19.025 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:45.091 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:06:19.154 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:45.096 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:06:19.160 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:00:45.240 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:06:19.252 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.257 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:11:32.320 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.263 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:11:32.326 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.514 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:11:32.578 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.743 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:11:32.755 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.744 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:11:32.807 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.752 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:11:32.763 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:58.757 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:11:32.820 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:59.018 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:11:33.081 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:05:59.050 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:11:33.062 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.878 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:11:42.942 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.893 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:11:42.957 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.916 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:11:42.980 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.921 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:11:42.985 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.923 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:11:42.935 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.933 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:11:42.997 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.933 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:11:42.945 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.964 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:11:43.028 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:08.971 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:11:42.983 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.497 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:16:43.560 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.504 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:16:43.568 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.519 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:16:43.582 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.524 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:16:43.588 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.526 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:16:43.538 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.540 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:16:43.552 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.702 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:16:43.766 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.710 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:16:43.773 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:09.761 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:16:43.772 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:30.902 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:20:04.965 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:30.905 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:20:04.969 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:30.923 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:20:04.987 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:30.925 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:20:04.989 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:30.948 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:20:04.960 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:30.956 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:20:04.968 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:31.007 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:20:05.070 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:31.055 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:20:05.118 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:31.110 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:20:05.122 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.355 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:21:55.419 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.365 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:21:55.428 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.384 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:21:55.447 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.389 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:21:55.452 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.395 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:21:55.406 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.403 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:21:55.415 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.501 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:21:55.557 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.501 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:21:55.561 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:16:21.530 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:21:55.542 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.750 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:27:07.813 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.763 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:27:07.821 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.773 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:27:07.837 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.778 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:27:07.789 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.782 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:27:07.846 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.798 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:27:07.810 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.967 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:27:08.030 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:33.992 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:27:08.055 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:21:34.150 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:27:08.161 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.646 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:28:26.709 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.658 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:28:26.722 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.699 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:28:26.763 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.702 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:28:26.765 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.727 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:28:26.739 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.733 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:28:26.741 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.733 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:28:26.796 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.754 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:28:26.817 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:52.865 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:28:26.877 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.463 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:32:18.526 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.475 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:32:18.537 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.483 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:32:18.547 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.493 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:32:18.554 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.498 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:32:18.506 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.501 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:32:18.512 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.646 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:32:18.709 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.681 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:32:18.744 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:26:44.693 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:32:18.696 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.379 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:36:48.442 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.394 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:36:48.449 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.404 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:36:48.467 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.405 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:36:48.469 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.409 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:36:48.421 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.466 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:36:48.477 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.517 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:36:48.580 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.577 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:36:48.640 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:14.642 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:36:48.654 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.153 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:37:30.216 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.157 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:37:30.221 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.169 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:37:30.232 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.174 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:37:30.237 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.176 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:37:30.188 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.200 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:37:30.212 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.216 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:37:30.279 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.231 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:37:30.295 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:56.406 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:37:30.417 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.686 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:42:42.749 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.695 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:42:42.758 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.701 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:42:42.765 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.706 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:42:42.770 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.711 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:42:42.722 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.743 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:42:42.749 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.898 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:42:42.961 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:08.904 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:42:42.968 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:09.025 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:42:43.036 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.259 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:44:45.322 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.292 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:44:45.356 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.360 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:44:45.423 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.365 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:44:45.425 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.378 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:44:45.389 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.380 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:44:45.392 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.408 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:44:45.471 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.466 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:44:45.529 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:11.511 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:44:45.522 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.463 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:45:10.526 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.484 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:45:10.547 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.526 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:45:10.589 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.527 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:45:10.590 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.549 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:45:10.612 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.567 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:45:10.630 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.568 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:45:10.579 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.573 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:45:10.584 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:36.680 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:45:10.691 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.161 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:47:52.224 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.169 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:47:52.232 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.184 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:47:52.248 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.190 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:47:52.201 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.192 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:47:52.255 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.198 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:47:52.209 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.303 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:47:52.366 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.319 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:47:52.382 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:42:18.404 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:47:52.415 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:30.779 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:53:04.842 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:30.790 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:53:04.852 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:30.802 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:53:04.865 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:30.806 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:53:04.869 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:30.812 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:53:04.824 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:30.847 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:53:04.857 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:31.011 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:53:05.074 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:31.021 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:53:05.084 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:31.172 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:53:05.183 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.176 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:53:32.238 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.178 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:53:32.242 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.217 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:53:32.280 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.234 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:53:32.297 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.239 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:53:32.302 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.254 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:53:32.265 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.261 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:53:32.272 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.266 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:53:32.329 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:47:58.311 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:53:32.322 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:40.926 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:58:14.988 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:40.945 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:58:14.997 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:40.946 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:58:15.005 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:40.947 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:58:15.010 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:40.961 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:58:14.971 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:40.983 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:58:14.994 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:41.149 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:10:58:15.212 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:41.161 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:10:58:15.224 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:41.323 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:10:58:15.334 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:19.828 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:01:53.890 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:19.901 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:01:53.964 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:19.918 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:01:53.929 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:19.921 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:01:53.932 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:19.927 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:01:53.990 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:19.959 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:01:54.022 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:20.045 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:01:54.055 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:20.075 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:01:54.138 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:20.129 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:01:54.192 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.377 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:03:25.440 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.385 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:03:25.448 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.407 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:03:25.418 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.408 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:03:25.471 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.413 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:03:25.476 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.418 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:03:25.429 8264== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.500 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:03:25.563 8647== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.514 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:03:25.577 8648== Warning: unimplemented fcntl command: 1036 2019-11-27T23:57:51.594 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:03:25.605 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.324 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:08:37.387 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.336 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:08:37.396 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.338 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:08:37.402 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.342 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:08:37.405 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.358 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:08:37.369 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.368 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:08:37.379 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.548 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:08:37.611 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.556 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:08:37.619 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:03:03.596 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:08:37.607 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.591 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:10:15.654 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.628 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:10:15.691 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.680 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:10:15.742 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.681 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:10:15.744 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.683 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:10:15.694 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.686 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:10:15.697 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.721 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:10:15.784 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.740 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:10:15.803 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:41.768 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:10:15.779 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.520 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:13:49.583 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.529 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:13:49.592 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.531 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:13:49.594 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.536 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:13:49.599 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.554 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:13:49.565 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.585 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:13:49.596 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.707 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:13:49.770 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.753 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:13:49.816 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:08:15.822 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:13:49.833 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.336 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:18:37.399 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.342 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:18:37.405 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.414 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:18:37.477 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.416 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:18:37.427 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.417 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:18:37.479 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.420 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:18:37.431 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.563 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:18:37.626 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.573 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:18:37.636 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:03.605 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:18:37.616 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.678 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:19:01.741 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.692 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:19:01.755 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.707 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:19:01.770 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.712 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:19:01.775 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.724 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:19:01.735 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.730 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:19:01.793 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.747 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:19:01.758 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.773 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:19:01.835 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:27.826 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:19:01.837 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.687 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:24:14.750 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.695 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:24:14.758 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.705 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:24:14.768 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.711 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:24:14.774 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.720 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:24:14.731 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.725 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:24:14.736 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.990 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:24:15.053 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:40.990 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:24:15.053 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:18:41.029 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:24:15.040 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.109 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:25:34.172 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.113 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:25:34.176 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.183 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:25:34.246 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.192 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:25:34.254 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.203 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:25:34.264 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.210 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:25:34.220 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.217 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:25:34.228 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.278 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:25:34.340 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.284 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:25:34.295 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.444 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:26:59.507 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.494 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:26:59.557 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.555 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:26:59.618 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.568 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:26:59.631 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.604 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:26:59.615 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.607 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:26:59.618 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.611 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:26:59.674 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.677 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:26:59.688 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:25.679 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:26:59.742 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.100 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:29:26.163 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.115 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:29:26.178 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.120 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:29:26.183 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.127 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:29:26.190 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.140 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:29:26.151 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.167 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:29:26.178 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.223 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:29:26.286 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.269 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:29:26.332 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:23:52.403 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:29:26.414 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:06.985 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:34:41.047 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:06.996 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:34:41.059 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.010 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:34:41.073 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.017 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:34:41.080 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.019 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:34:41.030 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.042 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:34:41.053 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.188 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:34:41.251 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.327 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:34:41.389 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:07.400 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:34:41.411 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.170 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:35:21.233 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.177 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:35:21.240 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.223 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:35:21.286 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.239 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:35:21.301 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.239 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:35:21.302 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.255 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:35:21.266 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.263 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:35:21.274 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.288 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:35:21.351 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:29:47.332 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:35:21.343 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.088 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:39:52.150 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.106 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:39:52.159 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.111 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:39:52.122 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.116 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:39:52.179 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.118 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:39:52.129 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.121 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:39:52.184 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.311 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:11:39:52.374 8647== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.332 INFO:tasks.ceph.mon.b.smithi115.stderr:==00:11:39:52.343 8264== Warning: unimplemented fcntl command: 1036 2019-11-28T00:34:18.337 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:11:39:52.400 8648== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:40.500 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-28T00:35:40.510 DEBUG:teuthology.task.console_log:Killing console logger for smithi115 2019-11-28T00:35:40.511 DEBUG:teuthology.task.console_log:Killing console logger for smithi005 2019-11-28T00:35:40.511 DEBUG:teuthology.task.console_log:Killing console logger for smithi115 2019-11-28T00:35:40.511 DEBUG:teuthology.task.console_log:Killing console logger for smithi005 2019-11-28T00:35:40.512 DEBUG:teuthology.exit:Finished running handlers